atoti_ai_amazon_bedrock.ChatConfig

final class atoti_ai_amazon_bedrock.ChatConfig

Chat config for Amazon Bedrock.

Warning

This feature is experimental, its key is "ai".

See the corresponding Javadoc for more details.

See also

The other ChatConfig implementations.

max_tokens: int | None = None

Maximum number of tokens to generate in the response.

model: str

The ID of the model to use, for example "anthropic.claude-3-sonnet-20240229-v1:0".

temperature: float | None = None

Controls randomness in responses from 0.0 (deterministic) to 1.0 (creative).

top_k: int | None = None

Limits vocabulary to top K tokens at each generation step.

top_p: float | None = None

Nucleus sampling parameter.

Controls diversity via cumulative probability.