Commit graph

5 commits

Author SHA1 Message Date
Danny Avila
53569bfc15
fix: improve syncing when switching conversations 2025-12-18 14:12:14 -05:00
Danny Avila
1985e53b80
feat: Enhance Stream Management with Abort Functionality
- Updated the abort endpoint to support aborting ongoing generation streams using either streamId or conversationId.
- Introduced a new mutation hook `useAbortStreamMutation` for client-side integration.
- Added `useStreamStatus` query to monitor stream status and facilitate resuming conversations.
- Enhanced `useChatHelpers` to incorporate abort functionality when stopping generation.
- Improved `useResumableSSE` to handle stream errors and token refresh seamlessly.
- Updated `useResumeOnLoad` to check for active streams and resume conversations appropriately.
2025-12-18 14:12:14 -05:00
Danny Avila
0a517a2b8f
WIP: resumable stream 2025-12-18 14:12:13 -05:00
Danny Avila
4119935051
WIP: resuming 2025-12-18 14:12:13 -05:00
Danny Avila
9b9d6be622
feat: Implement Resumable Generation Jobs with SSE Support
- Introduced GenerationJobManager to handle resumable LLM generation jobs independently of HTTP connections.
- Added support for subscribing to ongoing generation jobs via SSE, allowing clients to reconnect and receive updates without losing progress.
- Enhanced existing agent controllers and routes to integrate resumable functionality, including job creation, completion, and error handling.
- Updated client-side hooks to manage adaptive SSE streams, switching between standard and resumable modes based on user settings.
- Added UI components and settings for enabling/disabling resumable streams, improving user experience during unstable connections.
2025-12-18 14:12:12 -05:00