Andreas/LibreChat
1
0
Fork 0
mirror of https://github.com/danny-avila/LibreChat.git synced 2025-12-17 17:00:15 +01:00
Code Issues Projects Releases Packages Wiki Activity Actions 7

🎯 fix: Google AI Client Stability; feat: gemini-exp models (#4781)

Browse source 
* fix: Google timing out and issuing AbortError, bump package, and use `@google/generative-ai` explicitly for latest models

* feat: gemini-exp-
This commit is contained in:
Danny Avila 2024-11-22 19:08:14 -05:00 • committed by GitHub
parent 56b60cf863
commit 2a77c98f51
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
5 changed files with 19 additions and 22 deletions
Download patch file Download diff file Expand all files Collapse all files

1
api/utils/tokens.js
View file

@ -49,6 +49,7 @@ const googleModels = {
/* Max I/O is combined so we subtract the amount from max response tokens for actual total */
gemini: 30720, // -2048 from max
'gemini-pro-vision': 12288, // -4096 from max
'gemini-exp': 8000,
'gemini-1.5': 1048576, // -8192 from max
'text-bison-32k': 32758, // -10 from max
'chat-bison-32k': 32758, // -10 from max