LibreChat/api/app/clients
Danny Avila 0c326797dd
📸 feat: Gemini vision, Improved Logs and Multi-modal Handling (#1368)
* feat: add GOOGLE_MODELS env var

* feat: add gemini vision support

* refactor(GoogleClient): adjust clientOptions handling depending on model

* fix(logger): fix redact logic and redact errors only

* fix(GoogleClient): do not allow non-multiModal messages when gemini-pro-vision is selected

* refactor(OpenAIClient): use `isVisionModel` client property to avoid calling validateVisionModel multiple times

* refactor: better debug logging by correctly traversing, redacting sensitive info, and logging condensed versions of long values

* refactor(GoogleClient): allow response errors to be thrown/caught above client handling so user receives meaningful error message
debug orderedMessages, parentMessageId, and buildMessages result

* refactor(AskController): use model from client.modelOptions.model when saving intermediate messages, which requires for the progress callback to be initialized after the client is initialized

* feat(useSSE): revert to previous model if the model was auto-switched by backend due to message attachments

* docs: update with google updates, notes about Gemini Pro Vision

* fix: redis should not be initialized without USE_REDIS and increase max listeners to 20
2023-12-16 20:45:27 -05:00
..
agents refactor(api): Central Logging 📜 (#1348) 2023-12-14 07:49:27 -05:00
callbacks fix: Avoid Throwing Errors for Unsupported Token Count Endpoints 🪙 (#1356) 2023-12-15 02:40:15 -05:00
chains refactor(api): Central Logging 📜 (#1348) 2023-12-14 07:49:27 -05:00
document feat: ConversationSummaryBufferMemory (#973) 2023-09-26 21:02:28 -04:00
llm refactor(api): Central Logging 📜 (#1348) 2023-12-14 07:49:27 -05:00
memory refactor(api): Central Logging 📜 (#1348) 2023-12-14 07:49:27 -05:00
output_parsers refactor(api): Central Logging 📜 (#1348) 2023-12-14 07:49:27 -05:00
prompts feat(Google): Support all Text/Chat Models, Response streaming, PaLM -> Google 🤖 (#1316) 2023-12-10 14:54:13 -05:00
specs fix: Enhance Test Coverage and Fix Compatibility Issues 👷‍♂️ (#1363) 2023-12-15 13:27:13 -05:00
tools refactor(api): Central Logging 📜 (#1348) 2023-12-14 07:49:27 -05:00
AnthropicClient.js 🔄 refactor: Consolidate Ask/Edit Controllers (#1365) 2023-12-15 15:47:40 -05:00
BaseClient.js 📸 feat: Gemini vision, Improved Logs and Multi-modal Handling (#1368) 2023-12-16 20:45:27 -05:00
ChatGPTClient.js fix: Enhance Test Coverage and Fix Compatibility Issues 👷‍♂️ (#1363) 2023-12-15 13:27:13 -05:00
GoogleClient.js 📸 feat: Gemini vision, Improved Logs and Multi-modal Handling (#1368) 2023-12-16 20:45:27 -05:00
index.js ci(backend-review.yml): add linter step to the backend review workflow (#625) 2023-07-14 09:36:49 -04:00
OpenAIClient.js 📸 feat: Gemini vision, Improved Logs and Multi-modal Handling (#1368) 2023-12-16 20:45:27 -05:00
PluginsClient.js 📸 feat: Gemini vision, Improved Logs and Multi-modal Handling (#1368) 2023-12-16 20:45:27 -05:00
TextStream.js refactor(api): Central Logging 📜 (#1348) 2023-12-14 07:49:27 -05:00