You're looking at a specific version of this model. Jump to the model overview.

zsxkib /animatediff-illusions:b3ccb010

Input schema

The fields you can use to run this model with an API. If you don’t give a value for a field its default value will be used.

Field Type Default value Description
controlnet_video
string
A short video/gif that will be used as the keyframes for QR Code Monster to use, Please note, all of the frames will be used as keyframes
enable_qr_code_monster_v2
boolean
True
Flag to enable QR Code Monster V2 ControlNet
qr_code_monster_v2_preprocessor
boolean
True
Flag to pre-process keyframes for QR Code Monster V2 ControlNet
qr_code_monster_v2_guess_mode
boolean
False
Flag to enable guess mode (un-guided) for QR Code Monster V2 ControlNet
controlnet_conditioning_scale
number
0.18
Strength of ControlNet. The outputs of the ControlNet are multiplied by `controlnet_conditioning_scale` before they are added to the residual in the original UNet
loop
boolean
True
Flag to loop the video. Use when you have an 'infinitely' repeating video/gif ControlNet video
head_prompt
string
masterpiece, best quality, a haunting and detailed depiction of a ship at sea, battered by waves, ominous,((dark clouds:1.3)),distant lightning, rough seas, rain, silhouette of the ship against the stormy sky
Primary animation prompt. If a prompt map is provided, this will be prefixed at the start of every individual prompt in the map
prompt_map
string
Prompt for changes in animation. Provide 'frame number : prompt at this frame', separate different prompts with '|'. Make sure the frame number does not exceed the length of video (frames)
tail_prompt
string
Additional prompt that will be appended at the end of the main prompt or individual prompts in the map
negative_prompt
string
None
frames
integer
128

Min: 1

Max: 1024

Length of the video in frames (playback is at 8 fps e.g. 16 frames @ 8 fps is 2 seconds)
width
integer
256

Min: 64

Max: 2160

Width of generated video in pixels, must be divisable by 8
height
integer
384

Min: 64

Max: 2160

Height of generated video in pixels, must be divisable by 8
base_model
string (enum)
majicmixRealistic_v5Preview

Options:

realisticVisionV40_v20Novae, lyriel_v16, majicmixRealistic_v5Preview, rcnzCartoon3d_v10, toonyou_beta3, CUSTOM

Choose the base model for animation generation. If 'CUSTOM' is selected, provide a custom model URL in the next parameter
custom_base_model_url
string
Only used when base model is set to 'CUSTOM'. URL of the custom model to download if 'CUSTOM' is selected in the base model. Only downloads from 'https://civitai.com/api/download/models/' are allowed
prompt_fixed_ratio
number
0.5

Max: 1

Defines the ratio of adherence to the fixed part of the prompt versus the dynamic part (from prompt map). Value should be between 0 (only dynamic) to 1 (only fixed).
scheduler
string (enum)
k_dpmpp_sde

Options:

ddim, pndm, heun, unipc, euler, euler_a, lms, k_lms, dpm_2, k_dpm_2, dpm_2_a, k_dpm_2_a, dpmpp_2m, k_dpmpp_2m, dpmpp_sde, k_dpmpp_sde, dpmpp_2m_sde, k_dpmpp_2m_sde

Diffusion scheduler
steps
integer
25

Min: 1

Max: 100

Number of inference steps
guidance_scale
number
7.5

Max: 20

Guidance Scale. How closely do we want to adhere to the prompt and its contents
clip_skip
integer
2

Min: 1

Max: 6

Skip the last N-1 layers of the CLIP text encoder (lower values follow prompt more closely)
context
integer
16

Min: 1

Max: 32

Number of frames to condition on (default: max of <length> or 32). max for motion module v1 is 24
output_format
string (enum)
mp4

Options:

mp4, gif

Output format of the video. Can be 'mp4' or 'gif'
playback_frames_per_second
integer
8

Min: 1

Max: 60

None
film_interpolation
boolean
True
Whether to use FILM for between-frame interpolation (film-net.github.io)
num_interpolation_steps
integer
3

Min: 1

Max: 50

Number of steps to interpolate between animation frames
seed
integer
Seed for different images and reproducibility. Leave blank to randomise seed

Output schema

The shape of the response you’ll get when you run this model with an API.

Schema
{'format': 'uri', 'title': 'Output', 'type': 'string'}