LibreChat/api/server/services/Files/images
Danny Avila 0c326797dd
📸 feat: Gemini vision, Improved Logs and Multi-modal Handling (#1368)
* feat: add GOOGLE_MODELS env var

* feat: add gemini vision support

* refactor(GoogleClient): adjust clientOptions handling depending on model

* fix(logger): fix redact logic and redact errors only

* fix(GoogleClient): do not allow non-multiModal messages when gemini-pro-vision is selected

* refactor(OpenAIClient): use `isVisionModel` client property to avoid calling validateVisionModel multiple times

* refactor: better debug logging by correctly traversing, redacting sensitive info, and logging condensed versions of long values

* refactor(GoogleClient): allow response errors to be thrown/caught above client handling so user receives meaningful error message
debug orderedMessages, parentMessageId, and buildMessages result

* refactor(AskController): use model from client.modelOptions.model when saving intermediate messages, which requires for the progress callback to be initialized after the client is initialized

* feat(useSSE): revert to previous model if the model was auto-switched by backend due to message attachments

* docs: update with google updates, notes about Gemini Pro Vision

* fix: redis should not be initialized without USE_REDIS and increase max listeners to 20
2023-12-16 20:45:27 -05:00
..
convert.js 🛠️ refactor: Handle .webp, Improve File Life Cycle 📁 (#1213) 2023-11-24 16:45:06 -05:00
encode.js 📸 feat: Gemini vision, Improved Logs and Multi-modal Handling (#1368) 2023-12-16 20:45:27 -05:00
index.js feat: Vision Support + New UI (#1203) 2023-11-21 20:12:48 -05:00
resize.js fix(images/resize): invoke rotate to auto-orient the image based on the EXIF data (#1250) 2023-11-30 13:59:51 -05:00
validate.js refactor: Use librechat-data-provider app-wide 🔄 (#1326) 2023-12-11 14:48:40 -05:00