You're looking at a specific version of this model. Jump to the model overview.

deforum-art /deforum-stable-diffusion:1a983035

Input schema

The fields you can use to run this model with an API. If you don’t give a value for a field its default value will be used.

Field Type Default value Description
model_checkpoint
string (enum)
Protogen_V2.2.ckpt

Options:

v2-1_768-ema-pruned.ckpt, v2-1_512-ema-pruned.ckpt, 768-v-ema.ckpt, 512-base-ema.ckpt, Protogen_V2.2.ckpt, v1-5-pruned.ckpt, v1-5-pruned-emaonly.ckpt, sd-v1-4.ckpt, robo-diffusion-v1.ckpt, wd-v1-3-float16.ckpt

Choose stable diffusion model.
max_frames
integer
200
Number of frames for animation
animation_prompts
string
0: a beautiful apple, trending on Artstation | 50: a beautiful banana, trending on Artstation | 100: a beautiful coconut, trending on Artstation | 150: a beautiful durian, trending on Artstation
Prompt for animation. Provide 'frame number : prompt at this frame', separate different prompts with '|'. Make sure the frame number does not exceed the max_frames.
width
integer (enum)
512

Options:

128, 256, 384, 448, 512, 576, 640, 704, 768, 832, 896, 960, 1024

Width of output video. Reduce if out of memory.
height
integer (enum)
512

Options:

128, 256, 384, 448, 512, 576, 640, 704, 768, 832, 896, 960, 1024

Height of output image. Reduce if out of memory.
num_inference_steps
integer
50

Min: 1

Max: 500

Number of denoising steps
guidance_scale
number
7

Min: 1

Max: 20

Scale for classifier-free guidance
sampler
string (enum)
euler_ancestral

Options:

klms, dpm2, dpm2_ancestral, heun, euler, euler_ancestral, plms, ddim, dpm_fast, dpm_adaptive, dpmpp_2s_a, dpmpp_2m

An enumeration.
seed
integer
Random seed. Leave blank to randomize the seed
fps
integer
15

Min: 10

Max: 60

Choose fps for the video.
clip_name
string (enum)
ViT-L/14

Options:

ViT-L/14, ViT-L/14@336px, ViT-B/16, ViT-B/32

Choose CLIP model
use_init
boolean
False
If not using init image, you can skip the next settings to setting the animation_mode.
init_image
string
Provide init_image if use_init
use_mask
boolean
False
None
mask_file
string
Provide mask_file if use_mask
invert_mask
boolean
False
None
animation_mode
string (enum)
2D

Options:

2D, 3D, Video Input, Interpolation

Choose Animation mode. All parameters below are for setting up animations.
border
string (enum)
replicate

Options:

wrap, replicate

An enumeration.
angle
string
0:(0)
angle parameter for the motion
zoom
string
0:(1.04)
zoom parameter for the motion
translation_x
string
0:(10*sin(2*3.14*t/10))
translation_x parameter for the 2D motion
translation_y
string
0:(0)
translation_y parameter for the 2D motion
translation_z
string
0:(10)
translation_z parameter for the 2D motion
rotation_3d_x
string
0:(0)
rotation_3d_x parameter for the 3D motion
rotation_3d_y
string
0:(0)
rotation_3d_y parameter for the 3D motion
rotation_3d_z
string
0:(0)
rotation_3d_z parameter for the 3D motion
flip_2d_perspective
boolean
False
None
perspective_flip_theta
string
0:(0)
None
perspective_flip_phi
string
0:(t%15)
None
perspective_flip_gamma
string
0:(0)
None
perspective_flip_fv
string
0:(53)
None
noise_schedule
string
0: (0.02)
None
strength_schedule
string
0: (0.65)
None
contrast_schedule
string
0: (1.0)
None
hybrid_video_comp_alpha_schedule
string
0:(1)
None
hybrid_video_comp_mask_blend_alpha_schedule
string
0:(0.5)
None
hybrid_video_comp_mask_contrast_schedule
string
0:(1)
None
hybrid_video_comp_mask_auto_contrast_cutoff_high_schedule
string
0:(100)
None
hybrid_video_comp_mask_auto_contrast_cutoff_low_schedule
string
0:(0)
None
kernel_schedule
string
0: (5)
None
sigma_schedule
string
0: (1.0)
None
amount_schedule
string
0: (0.2)
None
threshold_schedule
string
0: (0.0)
None
color_coherence
string (enum)
Match Frame 0 LAB

Options:

Match Frame 0 HSV, Match Frame 0 LAB, Match Frame 0 RGB, Video Input

An enumeration.
color_coherence_video_every_N_frames
integer
1
None
diffusion_cadence
string (enum)
1

Options:

1, 2, 3, 4, 5, 6, 7, 8

An enumeration.
use_depth_warping
boolean
True
None
midas_weight
number
0.3
None
near_plane
integer
200
None
far_plane
integer
10000
None
fov
integer
40
None
padding_mode
string (enum)
border

Options:

border, reflection, zeros

An enumeration.
sampling_mode
string (enum)
bicubic

Options:

bicubic, bilinear, nearest

An enumeration.
video_init_path
string
None
extract_nth_frame
integer
1
None
overwrite_extracted_frames
boolean
True
None
use_mask_video
boolean
False
None
video_mask_path
string
None
hybrid_video_generate_inputframes
boolean
False
None
hybrid_video_use_first_frame_as_init_image
boolean
True
None
hybrid_video_motion
string (enum)
None

Options:

None, Optical Flow, Perspective, Affine

An enumeration.
hybrid_video_flow_method
string (enum)
Farneback

Options:

Farneback, DenseRLOF, SF

An enumeration.
hybrid_video_composite
boolean
False
None
hybrid_video_comp_mask_type
string (enum)
None

Options:

None, Depth, Video Depth, Blend, Difference

An enumeration.
hybrid_video_comp_mask_inverse
boolean
False
None
hybrid_video_comp_mask_equalize
string (enum)
None

Options:

None, Before, After, Both

An enumeration.
hybrid_video_comp_mask_auto_contrast
boolean
False
None
hybrid_video_comp_save_extra_frames
boolean
False
None
hybrid_video_use_video_as_mse_image
boolean
False
None
interpolate_key_frames
boolean
False
None
interpolate_x_frames
integer
4
None
resume_from_timestring
boolean
False
None
resume_timestring
string
None

Output schema

The shape of the response you’ll get when you run this model with an API.

Schema
{'format': 'uri', 'title': 'Output', 'type': 'string'}