LibreChat/packages/api/src/stream
Danny Avila cae8c06c9c
feat: Implement Resumable Generation Jobs with SSE Support
- Introduced GenerationJobManager to handle resumable LLM generation jobs independently of HTTP connections.
- Added support for subscribing to ongoing generation jobs via SSE, allowing clients to reconnect and receive updates without losing progress.
- Enhanced existing agent controllers and routes to integrate resumable functionality, including job creation, completion, and error handling.
- Updated client-side hooks to manage adaptive SSE streams, switching between standard and resumable modes based on user settings.
- Added UI components and settings for enabling/disabling resumable streams, improving user experience during unstable connections.
2025-12-17 08:43:22 -05:00
..
GenerationJobManager.ts feat: Implement Resumable Generation Jobs with SSE Support 2025-12-17 08:43:22 -05:00
index.ts feat: Implement Resumable Generation Jobs with SSE Support 2025-12-17 08:43:22 -05:00
types.ts feat: Implement Resumable Generation Jobs with SSE Support 2025-12-17 08:43:22 -05:00