Mistral: Mixtral 8x22B Instruct

mistralai/mixtral-8x22b-instruct

Modalities: text+file->text
In / out price: $2 / $6
Context: 66K
Released: Apr 17, 2024
Knowledge cutoff: 2024-01-31

Mistral's official instruct fine-tuned version of Mixtral 8x22B. It uses 39B active parameters out of 141B, offering unparalleled cost efficiency for its size. Its strengths include: - strong math, coding,...

ToolsStructured output

Supported parameters

frequency_penalty
Frequency penalty
Lowers the chance of a token in proportion to how often it already appeared.
max_tokens
Max tokens
Upper bound on generated tokens. Output stops at the limit.
presence_penalty
Presence penalty
Lowers the chance of any token that has already appeared.
response_format
Response format
For example json_object or json_schema, to constrain the shape.
seed
Seed
A fixed seed helps reproduce sampling. It does not guarantee byte-identical output.
stop
Stop
Stop when these strings are produced. A string or an array of strings.
structured_outputs
Structured outputs
Generate a parseable structure that follows a JSON Schema.
temperature
Temperature
Sampling temperature. Lower is steadier, higher is more varied. Often 0 to 2.Default 0.3
tool_choice
Tool choice
Whether to call a tool: auto, none, or a named function.
tools
Tools
Function definitions the model may call via tool_calls.
top_p
Top-p
Sample only from tokens whose cumulative probability reaches top_p.

Models Mistral

Mistral: Mixtral 8x22B Instruct

mistralai/mixtral-8x22b-instruct

Try this model

Modalities: text+file->text
In / out price: $2 / $6
Context: 66K
Released: Apr 17, 2024
Knowledge cutoff: 2024-01-31

ToolsStructured output

Supported parameters

frequency_penalty
Frequency penalty
Lowers the chance of a token in proportion to how often it already appeared.
max_tokens
Max tokens
Upper bound on generated tokens. Output stops at the limit.
presence_penalty
Presence penalty
Lowers the chance of any token that has already appeared.
response_format
Response format
For example json_object or json_schema, to constrain the shape.
seed
Seed
A fixed seed helps reproduce sampling. It does not guarantee byte-identical output.
stop
Stop
Stop when these strings are produced. A string or an array of strings.
structured_outputs
Structured outputs
Generate a parseable structure that follows a JSON Schema.
temperature
Temperature
Sampling temperature. Lower is steadier, higher is more varied. Often 0 to 2.Default 0.3
tool_choice
Tool choice
Whether to call a tool: auto, none, or a named function.
tools
Tools
Function definitions the model may call via tool_calls.
top_p
Top-p
Sample only from tokens whose cumulative probability reaches top_p.