You're looking at a specific version of this model. Jump to the model overview.

joehoover /falcon-40b-instruct:7eb0f4b1

Input schema

The fields you can use to run this model with an API. If you don’t give a value for a field its default value will be used.

Field Type Default value Description
prompt
string
Prompt to send to the model.
max_length
integer
500

Min: 1

Maximum number of tokens to generate. A word is generally 2-3 tokens
temperature
number
0.75

Min: 0.01

Max: 5

Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.
top_p
number
1

Min: 0.01

Max: 1

When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens
repetition_penalty
number
1

Min: 0.01

Max: 5

Penalty for repeated words in generated text; 1 is no penalty, values greater than 1 discourage repetition, less than 1 encourage it.
length_penalty
number
1

Min: 0.01

Max: 5

Increasing the length_penalty parameter above 1.0 will cause the model to favor longer sequences, while decreasing it below 1.0 will cause the model to favor shorter sequences.
no_repeat_ngram_size
integer
0
If set to int > 0, all ngrams of size no_repeat_ngram_size can only occur once.
stop_sequences
string
Comma delimited string specifying stop sequences. Multi-token stop sequences are supported, but they cannot contain commas.
seed
integer
-1

Min: -1

Set seed for reproducible outputs. Set to -1 for random seed.
debug
boolean
False
provide debugging output in logs

Output schema

The shape of the response you’ll get when you run this model with an API.

Schema
{'items': {'type': 'string'},
 'title': 'Output',
 'type': 'array',
 'x-cog-array-display': 'concatenate',
 'x-cog-array-type': 'iterator'}