Parameters
| Parameter | Type | Default | Description |
|---|---|---|---|
id | str | "command-r-plus-08-2024" | The id of the Cohere model to use |
name | str | "CohereChat" | The name of the model |
provider | str | "Cohere" | The provider of the model |
api_key | Optional[str] | None | The API key for Cohere (defaults to COHERE_API_KEY env var) |
max_tokens | Optional[int] | None | Maximum number of tokens to generate |
temperature | Optional[float] | None | Controls randomness in the model’s output (0.0 to 1.0) |
p | Optional[float] | None | Controls diversity via nucleus sampling (0.0 to 1.0) |
k | Optional[int] | None | Controls diversity via top-k sampling |
seed | Optional[int] | None | Random seed for deterministic sampling |
frequency_penalty | Optional[float] | None | Reduces repetition by penalizing frequent tokens (0.0 to 1.0) |
presence_penalty | Optional[float] | None | Reduces repetition by penalizing present tokens (0.0 to 1.0) |
stop_sequences | Optional[List[str]] | None | List of strings that stop generation |
response_format | Optional[Dict[str, Any]] | None | Specifies the format of the response (e.g., JSON) |
citation_options | Optional[Dict[str, Any]] | None | Options for citation generation |
request_params | Optional[Dict[str, Any]] | None | Additional parameters to include in the request |
client_params | Optional[Dict[str, Any]] | None | Additional parameters for client configuration |
retries | int | 0 | Number of retries to attempt before raising a ModelProviderError |
delay_between_retries | int | 1 | Delay between retries, in seconds |
exponential_backoff | bool | False | If True, the delay between retries is doubled each time |