You're looking at a specific version of this model. Jump to the model overview.

nateraw /mixtral-8x7b-32kseqlen:defd13a4

Input schema

The fields you can use to run this model with an API. If you don’t give a value for a field its default value will be used.

Field Type Default value Description
prompt
string
None
max_new_tokens
integer
512
The maximum number of tokens the model should generate as output.
temperature
number
0.6
The value used to modulate the next token probabilities.
top_p
number
0.9
A probability threshold for generating the output. If < 1.0, only keep the top tokens with cumulative probability >= top_p (nucleus filtering). Nucleus filtering is described in Holtzman et al. (http://arxiv.org/abs/1904.09751).

Output schema

The shape of the response you’ll get when you run this model with an API.

Schema
{'title': 'Output', 'type': 'string'}