Danny Avila a45b384bbc 💾 feat: Anthropic Prompt Caching (#3670) ... * wip: initial cache control implementation, add typing for transactions handling * feat: first pass of Anthropic Prompt Caching * feat: standardize stream usage as pass in when calculating token counts * feat: Add getCacheMultiplier function to calculate cache multiplier for different valueKeys and cacheTypes * chore: imports order * refactor: token usage recording in AnthropicClient, no need to "correct" as we have the correct amount * feat: more accurate token counting using stream usage data * feat: Improve token counting accuracy with stream usage data * refactor: ensure more accurate than not token estimations if custom instructions or files are not being resent with every request * refactor: cleanup updateUserMessageTokenCount to allow transactions to be as accurate as possible even if we shouldn't update user message token counts * ci: fix tests		2024-08-17 03:24:09 -04:00
..
index.js	✨ feat: Assistants API, General File Support, Side Panel, File Explorer (#1696)	2024-02-13 20:42:27 -05:00
manage.js	💾 feat: Anthropic Prompt Caching (#3670)	2024-08-17 03:24:09 -04:00
processMessages.spec.js	📜 fix: Better OpenAI Assistants Annotation Processing (#3565)	2024-08-06 18:52:58 -04:00