You're looking at a specific version of this model. Jump to the model overview.
joehoover /falcon-40b-instruct:7d58d6bd
Input schema
The fields you can use to run this model with an API. If you don’t give a value for a field its default value will be used.
| Field | Type | Default value | Description |
|---|---|---|---|
| prompt |
string
|
Prompt to send to the model.
|
|
| max_length |
integer
|
500
Min: 1 |
Maximum number of tokens to generate. A word is generally 2-3 tokens
|
| temperature |
number
|
0.75
Min: 0.01 Max: 5 |
Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.
|
| top_p |
number
|
1
Min: 0.01 Max: 1 |
When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens
|
| repetition_penalty |
number
|
1
Min: 0.01 Max: 5 |
Penalty for repeated words in generated text; 1 is no penalty, values greater than 1 discourage repetition, less than 1 encourage it.
|
| length_penalty |
number
|
1
Min: 0.01 Max: 5 |
Increasing the length_penalty parameter above 1.0 will cause the model to favor longer sequences, while decreasing it below 1.0 will cause the model to favor shorter sequences.
|
| no_repeat_ngram_size |
integer
|
0
|
If set to int > 0, all ngrams of size no_repeat_ngram_size can only occur once.
|
| stop_sequences |
string
|
Comma delimited string specifying stop sequences. Multi-token stop sequences are supported, but they cannot contain commas.
|
|
| seed |
integer
|
-1
Min: -1 |
Set seed for reproducible outputs. Set to -1 for random seed.
|
| debug |
boolean
|
False
|
provide debugging output in logs
|
Output schema
The shape of the response you’ll get when you run this model with an API.
Schema
{'items': {'type': 'string'},
'title': 'Output',
'type': 'array',
'x-cog-array-display': 'concatenate',
'x-cog-array-type': 'iterator'}