🧠 fix(Cohere): map to expected SDK params (#2329)

This commit is contained in:
Danny Avila 2024-04-05 16:45:18 -04:00 committed by GitHub
parent cd7f3a51e1
commit fb80af05be
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 9 additions and 9 deletions

View file

@ -69,13 +69,13 @@ function createCoherePayload({ modelOptions }) {
return {
message: latestUserMessageContent,
model: model,
chat_history: chatHistory,
chatHistory,
stream: stream ?? false,
temperature: temperature,
frequency_penalty: frequency_penalty,
presence_penalty: presence_penalty,
max_tokens: max_tokens,
stop_sequences: stop,
frequencyPenalty: frequency_penalty,
presencePenalty: presence_penalty,
maxTokens: max_tokens,
stopSequences: stop,
preamble,
p: top_p,
...rest,

View file

@ -23,13 +23,13 @@ Some of the endpoints are marked as **Known,** which means they might have speci
- Experimental: does not follow OpenAI-spec, uses a new method for endpoint compatibility, shares some similarities and parameters.
- For a full list of Cohere-specific parameters, see the [Cohere API documentation](https://docs.cohere.com/reference/chat).
- Note: The following parameters are recognized between OpenAI and Cohere. Most are removed in the example config below to prefer Cohere's default settings:
- `stop`: mapped to `stop_sequences`
- `stop`: mapped to `stopSequences`
- `top_p`: mapped to `p`, different min/max values
- `frequency_penalty`: different min/max values
- `presence_penalty`: different min/max values
- `frequency_penalty`: mapped to `frequencyPenalty`, different min/max values
- `presence_penalty`: mapped to `presencePenalty`, different min/max values
- `model`: shared, included by default.
- `stream`: shared, included by default.
- `max_tokens`: shared, not included by default.
- `max_tokens`: shared, mapped to `maxTokens`, not included by default.
```yaml