Commit graph

5 commits

Author SHA1 Message Date
Danny Avila
ff86f96416
refactor: Enhance GenerationJobManager with In-Memory Implementations
- Introduced InMemoryJobStore, InMemoryEventTransport, and InMemoryContentState for improved job management and event handling.
- Updated GenerationJobManager to utilize these new implementations, allowing for better separation of concerns and easier maintenance.
- Enhanced job metadata handling to support user messages and response IDs for resumable functionality.
- Improved cleanup and state management processes to prevent memory leaks and ensure efficient resource usage.
2025-12-15 18:48:56 -05:00
Danny Avila
1b2d3f30ef
fix: improve syncing when switching conversations 2025-12-15 18:48:54 -05:00
Danny Avila
1853b4a189
feat: Enhance Stream Management with Abort Functionality
- Updated the abort endpoint to support aborting ongoing generation streams using either streamId or conversationId.
- Introduced a new mutation hook `useAbortStreamMutation` for client-side integration.
- Added `useStreamStatus` query to monitor stream status and facilitate resuming conversations.
- Enhanced `useChatHelpers` to incorporate abort functionality when stopping generation.
- Improved `useResumableSSE` to handle stream errors and token refresh seamlessly.
- Updated `useResumeOnLoad` to check for active streams and resume conversations appropriately.
2025-12-15 18:48:53 -05:00
Danny Avila
ff14cd3b44
WIP: resumable stream 2025-12-15 18:48:53 -05:00
Danny Avila
2522cf760f
WIP: resuming 2025-12-15 18:48:52 -05:00