LibreChat/packages/api/src/stream/implementations/index.ts at 24c2545d4643a0fc6852bbc24161b8b630e5fcb0 - Andreas/LibreChat - Forgejo: Beyond coding. We Forge.

Andreas/LibreChat

mirror of https://github.com/danny-avila/LibreChat.git synced 2025-12-22 19:30:15 +01:00

Danny Avila 24c2545d46

feat: Introduce Redis-backed stream services for enhanced job management

- Added createStreamServices function to configure job store and event transport, supporting both Redis and in-memory options.
- Updated GenerationJobManager to allow configuration with custom job stores and event transports, improving flexibility for different deployment scenarios.
- Refactored IJobStore interface to support asynchronous content retrieval, ensuring compatibility with Redis implementations.
- Implemented RedisEventTransport for real-time event delivery across instances, enhancing scalability and responsiveness.
- Updated InMemoryJobStore to align with new async patterns for content and run step retrieval, ensuring consistent behavior across storage options.

2025-12-18 14:12:21 -05:00

4 lines

150 B

TypeScript

Raw Blame History

 export * from './InMemoryJobStore';
 export * from './InMemoryEventTransport';
 export * from './RedisJobStore';
 export * from './RedisEventTransport';