Andreas/LibreChat
1
0
Fork 0
mirror of https://github.com/danny-avila/LibreChat.git synced 2025-12-23 03:40:14 +01:00
Code Issues Projects Releases Packages Wiki Activity Actions

feat: Introduce Redis-backed stream services for enhanced job management

Browse source 
- Added createStreamServices function to configure job store and event transport, supporting both Redis and in-memory options.
- Updated GenerationJobManager to allow configuration with custom job stores and event transports, improving flexibility for different deployment scenarios.
- Refactored IJobStore interface to support asynchronous content retrieval, ensuring compatibility with Redis implementations.
- Implemented RedisEventTransport for real-time event delivery across instances, enhancing scalability and responsiveness.
- Updated InMemoryJobStore to align with new async patterns for content and run step retrieval, ensuring consistent behavior across storage options.
This commit is contained in:
Danny Avila 2025-12-14 23:45:08 -05:00
parent 0c10cf8c22
commit 24c2545d46
No known key found for this signature in database
GPG key ID: BF31EEB2C5CA0956
9 changed files with 835 additions and 49 deletions
Download patch file Download diff file Expand all files Collapse all files

1
packages/api/src/stream/implementations/index.ts
View file

@ -1,3 +1,4 @@
export * from './InMemoryJobStore';
export * from './InMemoryEventTransport';
export * from './RedisJobStore';
export * from './RedisEventTransport';