Cohere: Command R7B (12-2024)

Supported parameters

• frequency_penalty

  Frequency penalty

  Lowers the chance of a token in proportion to how often it already appeared.

• max_tokens

  Max tokens

  Upper bound on generated tokens. Output stops at the limit.

• presence_penalty

  Presence penalty

  Lowers the chance of any token that has already appeared.

• response_format

  Response format

  For example json_object or json_schema, to constrain the shape.

• seed

  Seed

  A fixed seed helps reproduce sampling. It does not guarantee byte-identical output.

• stop

  Stop

  Stop when these strings are produced. A string or an array of strings.

• structured_outputs

  Structured outputs

  Generate a parseable structure that follows a JSON Schema.

• temperature

  Temperature

  Sampling temperature. Lower is steadier, higher is more varied. Often 0 to 2.

• top_k

  Top-K

  Sample only from the K most likely tokens.

• top_p

  Top-p

  Sample only from tokens whose cumulative probability reaches top_p.