LibreChat/packages/api/src/stream/implementations
Danny Avila 0fa06af7b9
feat: Introduce Redis-backed stream services for enhanced job management
- Added createStreamServices function to configure job store and event transport, supporting both Redis and in-memory options.
- Updated GenerationJobManager to allow configuration with custom job stores and event transports, improving flexibility for different deployment scenarios.
- Refactored IJobStore interface to support asynchronous content retrieval, ensuring compatibility with Redis implementations.
- Implemented RedisEventTransport for real-time event delivery across instances, enhancing scalability and responsiveness.
- Updated InMemoryJobStore to align with new async patterns for content and run step retrieval, ensuring consistent behavior across storage options.
2025-12-17 08:43:32 -05:00
..
index.ts feat: Introduce Redis-backed stream services for enhanced job management 2025-12-17 08:43:32 -05:00
InMemoryEventTransport.ts refactor: Enhance GenerationJobManager with improved subscriber handling 2025-12-17 08:43:27 -05:00
InMemoryJobStore.ts feat: Introduce Redis-backed stream services for enhanced job management 2025-12-17 08:43:32 -05:00
RedisEventTransport.ts feat: Introduce Redis-backed stream services for enhanced job management 2025-12-17 08:43:32 -05:00
RedisJobStore.ts feat: Introduce Redis-backed stream services for enhanced job management 2025-12-17 08:43:32 -05:00