LibreChat/api
Danny Avila f427ad792a
🚀 feat: Assistants Streaming (#2159)
* chore: bump openai to 4.29.0 and npm audit fix

* chore: remove unnecessary stream field from ContentData

* feat: new enum and types for AssistantStreamEvent

* refactor(AssistantService): remove stream field and add conversationId to text ContentData
> - return `finalMessage` and `text` on run completion
> - move `processMessages` to services/Threads to avoid circular dependencies with new stream handling
> - refactor(processMessages/retrieveAndProcessFile): add new `client` field to differentiate new RunClient type

* WIP: new assistants stream handling

* chore: stores messages to StreamRunManager

* chore: add additional typedefs

* fix: pass req and openai to StreamRunManager

* fix(AssistantService): pass openai as client to `retrieveAndProcessFile`

* WIP: streaming tool i/o, handle in_progress and completed run steps

* feat(assistants): process required actions with streaming enabled

* chore: condense early return check for useSSE useEffect

* chore: remove unnecessary comments and only handle completed tool calls when not function

* feat: add TTL for assistants run abort cacheKey

* feat: abort stream runs

* fix(assistants): render streaming cursor

* fix(assistants): hide edit icon as functionality is not supported

* fix(textArea): handle pasting edge cases; first, when onChange events wouldn't fire; second, when textarea wouldn't resize

* chore: memoize Conversations

* chore(useTextarea): reverse args order

* fix: load default capabilities when an azure is configured to support assistants, but `assistants` endpoint is not configured

* fix(AssistantSelect): update form assistant model on assistant form select

* fix(actions): handle azure strict validation for function names to fix crud for actions

* chore: remove content data debug log as it fires in rapid succession

* feat: improve UX for assistant errors mid-request

* feat: add tool call localizations and replace any domain separators from azure action names

* refactor(chat): error out tool calls without outputs during handleError

* fix(ToolService): handle domain separators allowing Azure use of actions

* refactor(StreamRunManager): types and throw Error if tool submission fails
2024-03-21 22:42:25 -04:00
..
app 🗃️ feat: General File Support for OpenAI, Azure, Custom, Anthropic and Google (RAG) (#2143) 2024-03-19 20:54:30 -04:00
cache 🪙 feat: Assistants Token Balance & other improvements (#2114) 2024-03-15 19:48:42 -04:00
config 🖥️ feat: Match STDOUT Logs with Debug File Logs (#1944) 2024-03-01 13:42:04 -05:00
lib 🔄 refactor: Consolidate Ask/Edit Controllers (#1365) 2023-12-15 15:47:40 -05:00
models 🗃️ feat: General File Support for OpenAI, Azure, Custom, Anthropic and Google (RAG) (#2143) 2024-03-19 20:54:30 -04:00
server 🚀 feat: Assistants Streaming (#2159) 2024-03-21 22:42:25 -04:00
strategies 🌍 feat: Extend regex to support international usernames (#1918) 2024-02-28 14:27:57 -05:00
test 🚀 Feat: Streamline File Strategies & GPT-4-Vision Settings (#1535) 2024-01-11 11:37:54 -05:00
utils 🔬 chore: Add Circular Dependency Check to backend-review (#2149) 2024-03-20 12:15:42 -04:00
jest.config.js fix: Enhance Test Coverage and Fix Compatibility Issues 👷‍♂️ (#1363) 2023-12-15 13:27:13 -05:00
jsconfig.json feat(api): initial Redis support; fix(SearchBar): proper debounce (#1039) 2023-10-11 17:05:47 -04:00
package.json 🚀 feat: Assistants Streaming (#2159) 2024-03-21 22:42:25 -04:00
typedefs.js 🚀 feat: Assistants Streaming (#2159) 2024-03-21 22:42:25 -04:00