chenxwh / ominicontrol-subject

Minimal and Universal Control for Diffusion Transformer - demo for Subject-driven generation

  • Public
  • 1.2K runs
  • GitHub
  • Weights
  • Paper
  • License
Run with an API
Playground API Examples README Versions

OminiControl: Minimal and Universal Control for Diffusion Transformer

This is the demo for Subject-driven generation. See https://replicate.com/chenxwh/ominicontrol-spatial for Spatially aligned control.

Features

OminiControl is a minimal yet powerful universal control framework for Diffusion Transformer models like FLUX.

  • Universal Control 🌐: A unified control framework that supports both subject-driven control and spatial control (such as edge-guided and in-painting generation).

  • Minimal Design 🚀: Injects control signals while preserving original model structure. Only introduces 0.1% additional parameters to the base model.

Citation

@article{
  tan2024omini,
  title={OminiControl: Minimal and Universal Control for Diffusion Transformer},
  author={Zhenxiong Tan, Songhua Liu, Xingyi Yang, Qiaochu Xue, and Xinchao Wang},
  journal={arXiv preprint arXiv:2411.15098},
  year={2024}
}