WizardLM-2 8x22B

microsoft/wizardlm-2-8x22b

Modalities: text->text
In / out price: $0.62 / $0.62
Context: 66K
Released: Apr 16, 2024
Knowledge cutoff: 2024-04-30

WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models. It is...

Structured output

Supported parameters

frequency_penalty
Frequency penalty
Lowers the chance of a token in proportion to how often it already appeared.
max_tokens
Max tokens
Upper bound on generated tokens. Output stops at the limit.
presence_penalty
Presence penalty
Lowers the chance of any token that has already appeared.
repetition_penalty
Repetition penalty
Penalizes text that already appeared. Common on open models.
response_format
Response format
For example json_object or json_schema, to constrain the shape.
seed
Seed
A fixed seed helps reproduce sampling. It does not guarantee byte-identical output.
stop
Stop
Stop when these strings are produced. A string or an array of strings.
temperature
Temperature
Sampling temperature. Lower is steadier, higher is more varied. Often 0 to 2.
top_k
Top-K
Sample only from the K most likely tokens.
top_p
Top-p
Sample only from tokens whose cumulative probability reaches top_p.

Models Microsoft

WizardLM-2 8x22B

microsoft/wizardlm-2-8x22b

Try this model

Modalities: text->text
In / out price: $0.62 / $0.62
Context: 66K
Released: Apr 16, 2024
Knowledge cutoff: 2024-04-30

Structured output

Supported parameters

frequency_penalty
Frequency penalty
Lowers the chance of a token in proportion to how often it already appeared.
max_tokens
Max tokens
Upper bound on generated tokens. Output stops at the limit.
presence_penalty
Presence penalty
Lowers the chance of any token that has already appeared.
repetition_penalty
Repetition penalty
Penalizes text that already appeared. Common on open models.
response_format
Response format
For example json_object or json_schema, to constrain the shape.
seed
Seed
A fixed seed helps reproduce sampling. It does not guarantee byte-identical output.
stop
Stop
Stop when these strings are produced. A string or an array of strings.
temperature
Temperature
Sampling temperature. Lower is steadier, higher is more varied. Often 0 to 2.
top_k
Top-K
Sample only from the K most likely tokens.
top_p
Top-p
Sample only from tokens whose cumulative probability reaches top_p.