You're looking at a specific version of this model. Jump to the model overview.
zsxkib /animatediff-illusions:17b2ca47
            
              
                
              
            
            Input schema
          
        The fields you can use to run this model with an API. If you don’t give a value for a field its default value will be used.
| Field | Type | Default value | Description | 
|---|---|---|---|
| controlnet_video | 
           
            string
            
           
         | 
        
           
            A short video that will be used as the keyframes for QR Code Monster to use, Please note, all of the frames will be used as keyframes
           
         | 
      |
| enable_qr_code_monster_v2 | 
           
            boolean
            
           
         | 
        
          
             
              True
             
          
          
          
         | 
        
           
            Flag to enable QR Code Monster V2 ControlNet
           
         | 
      
| qr_code_monster_v2_preprocessor | 
           
            boolean
            
           
         | 
        
          
             
              True
             
          
          
          
         | 
        
           
            Flag to pre-process keyframes for QR Code Monster V2 ControlNet
           
         | 
      
| qr_code_monster_v2_guess_mode | 
           
            boolean
            
           
         | 
        
          
             
              False
             
          
          
          
         | 
        
           
            Flag to enable guess mode (un-guided) for QR Code Monster V2 ControlNet
           
         | 
      
| controlnet_conditioning_scale | 
           
            number
            
           
         | 
        
          
             
              0.18
             
          
          
          
         | 
        
           
            TODO
           
         | 
      
| head_prompt | 
           
            string
            
           
         | 
        
          
             
              masterpiece, best quality, a haunting and detailed depiction of a ship at sea, battered by waves, ominous,((dark clouds:1.3)),distant lightning, rough seas, rain, silhouette of the ship against the stormy sky
             
          
          
          
         | 
        
           
            Primary animation prompt. If a prompt map is provided, this will be prefixed at the start of every individual prompt in the map
           
         | 
      
| prompt_map | 
           
            string
            
           
         | 
        
          
             
              0: ship steadily moving,((waves crashing against the ship:1.0)) | 32: (((lightning strikes))), distant thunder, ship rocked by waves | 64: ship silhouette,(((heavy rain))),wind howling, waves rising higher | 96: ship navigating through the storm, rain easing off
             
          
          
          
         | 
        
           
            Prompt for changes in animation. Provide 'frame number : prompt at this frame', separate different prompts with '|'. Make sure the frame number does not exceed the length of video (frames)
           
         | 
      
| tail_prompt | 
           
            string
            
           
         | 
        
          
             
              dark horizon, flashes of lightning illuminating the ship, sailors working hard, ship's lanterns flickering, eerie, mysterious, sails flapping loudly, stormy atmosphere
             
          
          
          
         | 
        
           
            Additional prompt that will be appended at the end of the main prompt or individual prompts in the map
           
         | 
      
| negative_prompt | 
           
            string
            
           
         | 
        
          
             
              (worst quality, low quality:1.4), black and white, b&w, sunny, clear skies, calm seas, beach, daytime, ((bright colors)), cartoonish, modern ships, sketchy, unfinished, modern buildings, trees, island
             
          
          
          
         | 
        
           
            None
           
         | 
      
| frames | 
           
            integer
            
           
         | 
        
          
             
              128
             
          
          
          
            Min: 1 Max: 1024  | 
        
           
            Length of the video in frames (playback is at 8 fps e.g. 16 frames @ 8 fps is 2 seconds)
           
         | 
      
| width | 
           
            integer
            
           
         | 
        
          
             
              256
             
          
          
          
            Min: 64 Max: 2160  | 
        
           
            Width of generated video in pixels, must be divisable by 8
           
         | 
      
| height | 
           
            integer
            
           
         | 
        
          
             
              384
             
          
          
          
            Min: 64 Max: 2160  | 
        
           
            Height of generated video in pixels, must be divisable by 8
           
         | 
      
| base_model | 
           
            None
            
           
         | 
        
          
             
              majicmixRealistic_v5Preview
             
          
          
          
         | 
        
           
            Choose the base model for animation generation. If 'CUSTOM' is selected, provide a custom model URL in the next parameter
           
         | 
      
| custom_base_model_url | 
           
            string
            
           
         | 
        
          
             | 
        
           
            Only used when base model is set to 'CUSTOM'. URL of the custom model to download if 'CUSTOM' is selected in the base model. Only downloads from 'https://civitai.com/api/download/models/' are allowed
           
         | 
      
| prompt_fixed_ratio | 
           
            number
            
           
         | 
        
          
             
              0.5
             
          
          
          
            Max: 1  | 
        
           
            Defines the ratio of adherence to the fixed part of the prompt versus the dynamic part (from prompt map). Value should be between 0 (only dynamic) to 1 (only fixed).
           
         | 
      
| scheduler | 
           
            None
            
           
         | 
        
          
             
              k_dpmpp_sde
             
          
          
          
         | 
        
           
            Diffusion scheduler
           
         | 
      
| steps | 
           
            integer
            
           
         | 
        
          
             
              25
             
          
          
          
            Min: 1 Max: 100  | 
        
           
            Number of inference steps
           
         | 
      
| guidance_scale | 
           
            number
            
           
         | 
        
          
             
              7.5
             
          
          
          
            Max: 20  | 
        
           
            Guidance Scale. How closely do we want to adhere to the prompt and its contents
           
         | 
      
| clip_skip | 
           
            integer
            
           
         | 
        
          
             
              2
             
          
          
          
            Min: 1 Max: 6  | 
        
           
            Skip the last N-1 layers of the CLIP text encoder (lower values follow prompt more closely)
           
         | 
      
| context | 
           
            integer
            
           
         | 
        
          
             
              16
             
          
          
          
            Min: 1 Max: 32  | 
        
           
            Number of frames to condition on (default: max of <length> or 32). max for motion module v1 is 24
           
         | 
      
| output_format | 
           
            None
            
           
         | 
        
          
             
              mp4
             
          
          
          
         | 
        
           
            Output format of the video. Can be 'mp4' or 'gif'
           
         | 
      
| playback_frames_per_second | 
           
            integer
            
           
         | 
        
          
             
              8
             
          
          
          
            Min: 1 Max: 60  | 
        
           
            None
           
         | 
      
| seed | 
           
            integer
            
           
         | 
        
          
             
              -1
             
          
          
          
         | 
        
           
            Seed for different images and reproducibility. Use -1 to randomise seed
           
         | 
      
            
              
                
              
            
            Output schema
          
        The shape of the response you’ll get when you run this model with an API.
{'format': 'uri', 'title': 'Output', 'type': 'string'}