LibreChat/api/app/clients/tools/structured
Danny Avila 9d854dac07
🤖 feat: Gemini 1.5 Support (+Vertex AI) (#2383)
* WIP: gemini-1.5 support

* feat: extended vertex ai support

* fix: handle possibly undefined modelName

* fix: gpt-4-turbo-preview invalid vision model

* feat: specify `fileConfig.imageOutputType` and make PNG default image conversion type

* feat: better truncation for errors including base64 strings

* fix: gemini inlineData formatting

* feat: RAG augmented prompt for gemini-1.5

* feat: gemini-1.5 rates and token window

* chore: adjust tokens, update docs, update vision Models

* chore: add back `ChatGoogleVertexAI` for chat models via vertex ai

* refactor: ask/edit controllers to not use `unfinished` field for google endpoint

* chore: remove comment

* chore(ci): fix AppService test

* chore: remove comment

* refactor(GoogleSearch): use `GOOGLE_SEARCH_API_KEY` instead, issue warning for old variable

* chore: bump data-provider to 0.5.4

* chore: update docs

* fix: condition for gemini-1.5 using generative ai lib

* chore: update docs

* ci: add additional AppService test for `imageOutputType`

* refactor: optimize new config value `imageOutputType`

* chore: bump CONFIG_VERSION

* fix(assistants): avatar upload
2024-04-16 08:32:40 -04:00
..
specs feat: Assistants API, General File Support, Side Panel, File Explorer (#1696) 2024-02-13 20:42:27 -05:00
AzureAISearch.js feat: Assistants API, General File Support, Side Panel, File Explorer (#1696) 2024-02-13 20:42:27 -05:00
ChatTool.js refactor(plugins): Improve OpenAPI handling, Show Multiple Plugins, & Other Improvements (#845) 2023-08-28 12:03:08 -04:00
CodeSherpa.js refactor(api): Central Logging 📜 (#1348) 2023-12-14 07:49:27 -05:00
CodeSherpaTools.js refactor(api): Central Logging 📜 (#1348) 2023-12-14 07:49:27 -05:00
DALLE3.js 🎨 fix: Optimize StableDiffusion API Tool and Fix for Assistants Usage (#2253) 2024-03-30 20:09:59 -04:00
E2BTools.js refactor(api): Central Logging 📜 (#1348) 2023-12-14 07:49:27 -05:00
extractionChain.js refactor(plugins): Improve OpenAPI handling, Show Multiple Plugins, & Other Improvements (#845) 2023-08-28 12:03:08 -04:00
GoogleSearch.js 🤖 feat: Gemini 1.5 Support (+Vertex AI) (#2383) 2024-04-16 08:32:40 -04:00
StableDiffusion.js 🐞Fix: Stable Diffusion User Directory (#2270) 2024-04-01 15:55:44 -04:00
TavilySearchResults.js feat: Assistants API, General File Support, Side Panel, File Explorer (#1696) 2024-02-13 20:42:27 -05:00
TraversaalSearch.js 🔎 fix(Traversaal): Recognize authField during Tool Initialization 2024-03-06 10:59:00 -05:00
Wolfram.js feat: Assistants API, General File Support, Side Panel, File Explorer (#1696) 2024-02-13 20:42:27 -05:00