Andreas/LibreChat
1
0
Fork 0
mirror of https://github.com/danny-avila/LibreChat.git synced 2025-12-23 03:40:14 +01:00
Code Issues Projects Releases Packages Wiki Activity Actions

refactor: Consolidate content state management into IJobStore for improved job handling

Browse source 
- Removed InMemoryContentState and integrated its functionality into InMemoryJobStore, streamlining content state management.
- Updated GenerationJobManager to utilize jobStore for content state operations, enhancing clarity and reducing redundancy.
- Introduced RedisJobStore for horizontal scaling, allowing for efficient job management and content reconstruction from chunks.
- Updated IJobStore interface to reflect changes in content state handling, ensuring consistency across implementations.
This commit is contained in:
Danny Avila 2025-12-14 20:59:41 -05:00
parent 2da88a57fc
commit 0c10cf8c22
No known key found for this signature in database
GPG key ID: BF31EEB2C5CA0956
6 changed files with 632 additions and 156 deletions
Download patch file Download diff file Expand all files Collapse all files

2
packages/api/src/stream/implementations/index.ts
View file

@ -1,3 +1,3 @@
export * from './InMemoryJobStore';
export * from './InMemoryContentState';
export * from './InMemoryEventTransport';
export * from './RedisJobStore';