LibreChat/packages/api/src/stream
Danny Avila 0fa06af7b9
feat: Introduce Redis-backed stream services for enhanced job management
- Added createStreamServices function to configure job store and event transport, supporting both Redis and in-memory options.
- Updated GenerationJobManager to allow configuration with custom job stores and event transports, improving flexibility for different deployment scenarios.
- Refactored IJobStore interface to support asynchronous content retrieval, ensuring compatibility with Redis implementations.
- Implemented RedisEventTransport for real-time event delivery across instances, enhancing scalability and responsiveness.
- Updated InMemoryJobStore to align with new async patterns for content and run step retrieval, ensuring consistent behavior across storage options.
2025-12-17 08:43:32 -05:00
..
implementations feat: Introduce Redis-backed stream services for enhanced job management 2025-12-17 08:43:32 -05:00
interfaces feat: Introduce Redis-backed stream services for enhanced job management 2025-12-17 08:43:32 -05:00
createStreamServices.ts feat: Introduce Redis-backed stream services for enhanced job management 2025-12-17 08:43:32 -05:00
GenerationJobManager.ts feat: Introduce Redis-backed stream services for enhanced job management 2025-12-17 08:43:32 -05:00
index.ts feat: Introduce Redis-backed stream services for enhanced job management 2025-12-17 08:43:32 -05:00