LibreChat/client/src/hooks
Danny Avila 0c326797dd
📸 feat: Gemini vision, Improved Logs and Multi-modal Handling (#1368)
* feat: add GOOGLE_MODELS env var

* feat: add gemini vision support

* refactor(GoogleClient): adjust clientOptions handling depending on model

* fix(logger): fix redact logic and redact errors only

* fix(GoogleClient): do not allow non-multiModal messages when gemini-pro-vision is selected

* refactor(OpenAIClient): use `isVisionModel` client property to avoid calling validateVisionModel multiple times

* refactor: better debug logging by correctly traversing, redacting sensitive info, and logging condensed versions of long values

* refactor(GoogleClient): allow response errors to be thrown/caught above client handling so user receives meaningful error message
debug orderedMessages, parentMessageId, and buildMessages result

* refactor(AskController): use model from client.modelOptions.model when saving intermediate messages, which requires for the progress callback to be initialized after the client is initialized

* feat(useSSE): revert to previous model if the model was auto-switched by backend due to message attachments

* docs: update with google updates, notes about Gemini Pro Vision

* fix: redis should not be initialized without USE_REDIS and increase max listeners to 20
2023-12-16 20:45:27 -05:00
..
Config refactor: Speed up Config fetching and Setup Config Groundwork 👷🚧 (#1297) 2023-12-06 19:36:57 -05:00
Conversations refactor: Use librechat-data-provider app-wide 🔄 (#1326) 2023-12-11 14:48:40 -05:00
Input feat: Google Gemini ❇️ (#1355) 2023-12-15 02:18:07 -05:00
Messages 🛠️ refactor: Improve Input Placeholder Handling and Error Management 🔄 (#1296) 2023-12-06 14:10:06 -05:00
ApiErrorBoundaryContext.tsx refactor: Settings/Presets UI Restructure, convert many files to TS (#740) 2023-08-04 13:56:44 -04:00
AuthContext.tsx refactor: Use librechat-data-provider app-wide 🔄 (#1326) 2023-12-11 14:48:40 -05:00
index.ts refactor: Speed up Config fetching and Setup Config Groundwork 👷🚧 (#1297) 2023-12-06 19:36:57 -05:00
ScreenshotContext.tsx feat: Vision Support + New UI (#1203) 2023-11-21 20:12:48 -05:00
ThemeContext.tsx refactor: Settings/Presets UI Restructure, convert many files to TS (#740) 2023-08-04 13:56:44 -04:00
useChatHelpers.ts refactor: Use librechat-data-provider app-wide 🔄 (#1326) 2023-12-11 14:48:40 -05:00
useConversation.ts refactor: Use librechat-data-provider app-wide 🔄 (#1326) 2023-12-11 14:48:40 -05:00
useConversations.ts feat: OpenRouter Support & Improve Model Fetching ⇆ (#936) 2023-09-18 12:55:51 -04:00
useDefaultConvo.ts refactor: Use librechat-data-provider app-wide 🔄 (#1326) 2023-12-11 14:48:40 -05:00
useDelayedRender.tsx WIP: Update UI to match Official Style; Vision and Assistants 👷🏽 (#1190) 2023-11-16 10:42:24 -05:00
useDocumentTitle.ts refactor: Settings/Presets UI Restructure, convert many files to TS (#740) 2023-08-04 13:56:44 -04:00
useDragHelpers.ts feat: Vision Support + New UI (#1203) 2023-11-21 20:12:48 -05:00
useFileHandling.ts 🛠️ refactor: Handle .webp, Improve File Life Cycle 📁 (#1213) 2023-11-24 16:45:06 -05:00
useFileHandlingResize.ts feat: Vision Support + New UI (#1203) 2023-11-21 20:12:48 -05:00
useGenerations.ts feat(Google): Support all Text/Chat Models, Response streaming, PaLM -> Google 🤖 (#1316) 2023-12-10 14:54:13 -05:00
useGenerationsByLatest.ts feat(Google): Support all Text/Chat Models, Response streaming, PaLM -> Google 🤖 (#1316) 2023-12-10 14:54:13 -05:00
useLocalize.ts refactor: Settings/Presets UI Restructure, convert many files to TS (#740) 2023-08-04 13:56:44 -04:00
useLocalStorage.tsx refactor: Encrypt & Expire User Provided Keys, feat: Rate Limiting (#874) 2023-09-06 10:46:27 -04:00
useMediaQuery.tsx refactor: Settings/Presets UI Restructure, convert many files to TS (#740) 2023-08-04 13:56:44 -04:00
useMessageHandler.ts refactor: Use librechat-data-provider app-wide 🔄 (#1326) 2023-12-11 14:48:40 -05:00
useNavigateToConvo.tsx WIP: Update UI to match Official Style; Vision and Assistants 👷🏽 (#1190) 2023-11-16 10:42:24 -05:00
useNewConvo.ts refactor: Use librechat-data-provider app-wide 🔄 (#1326) 2023-12-11 14:48:40 -05:00
useOnClickOutside.ts WIP: Update UI to match Official Style; Vision and Assistants 👷🏽 (#1190) 2023-11-16 10:42:24 -05:00
useOriginNavigate.ts WIP: Update UI to match Official Style; Vision and Assistants 👷🏽 (#1190) 2023-11-16 10:42:24 -05:00
usePresetIndexOptions.ts WIP: Update UI to match Official Style; Vision and Assistants 👷🏽 (#1190) 2023-11-16 10:42:24 -05:00
usePresetOptions.ts Refactor: replace endpointsConfig recoil store with react query (#1085) 2023-10-21 13:50:29 -04:00
useScrollToRef.ts refactor: Consolidate Message Scrolling & other Logic to Custom Hooks 🔄 (#1257) 2023-12-01 19:54:09 -05:00
useServerStream.ts refactor: Use librechat-data-provider app-wide 🔄 (#1326) 2023-12-11 14:48:40 -05:00
useSetFilesToDelete.ts 🛠️ refactor: Handle .webp, Improve File Life Cycle 📁 (#1213) 2023-11-24 16:45:06 -05:00
useSetIndexOptions.ts WIP: Update UI to match Official Style; Vision and Assistants 👷🏽 (#1190) 2023-11-16 10:42:24 -05:00
useSetOptions.ts refactor(client): Refactors recent typescript changes for best practices (#763) 2023-08-05 16:45:26 -04:00
useSetStorage.ts WIP: Update UI to match Official Style; Vision and Assistants 👷🏽 (#1190) 2023-11-16 10:42:24 -05:00
useSSE.ts 📸 feat: Gemini vision, Improved Logs and Multi-modal Handling (#1368) 2023-12-16 20:45:27 -05:00
useTimeout.tsx feat: OpenRouter Support & Improve Model Fetching ⇆ (#936) 2023-09-18 12:55:51 -04:00
useToast.ts feat: Vision Support + New UI (#1203) 2023-11-21 20:12:48 -05:00