mirror of
https://github.com/danny-avila/LibreChat.git
synced 2025-12-16 16:30:15 +01:00
🪨 feat: Add Bedrock Prompt Caching Support (#8271)
* feat: Add Bedrock Cache Control Functionality - fix: Update Bedrock Cache Control to Require cachePoint as a Separate Content Block - Modified the addBedrockCacheControl function to ensure cachePoint is added as a separate content block in the content array, rather than as a property of text objects. - refactor: move addBedrockCacheControl over to packages/api - ci: add tests for addBedrockCacheControl until full coverage reached * ci: add test similar to example from the langchain PR * refactor: move addBedrockCacheControl logic and tests to agents repository * chore: remove extraneous comment * chore: update @librechat/agents dependency to version 3.0.12 * chore: update @librechat/agents dependency to version 3.0.13 * chore: update @librechat/agents dependency to version 3.0.14 * chore: update @librechat/agents to v3.0.15 * chore: update default value for prompt cache setting to true * refactor: set default promptCache to true for claude and nova models --------- Co-authored-by: Danny Avila <danny@librechat.ai>
This commit is contained in:
parent
bc561840bb
commit
c9ee0f138a
5 changed files with 37 additions and 8 deletions
|
|
@ -47,7 +47,7 @@
|
|||
"@langchain/google-genai": "^0.2.13",
|
||||
"@langchain/google-vertexai": "^0.2.13",
|
||||
"@langchain/textsplitters": "^0.1.0",
|
||||
"@librechat/agents": "^3.0.11",
|
||||
"@librechat/agents": "^3.0.15",
|
||||
"@librechat/api": "*",
|
||||
"@librechat/data-schemas": "*",
|
||||
"@microsoft/microsoft-graph-client": "^3.0.7",
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue