Diffusers documentation
Using Diffusers with other modalities
Get started
Tutorials
Using Diffusers
Loading & Hub
OverviewLoad pipelines, models, and schedulersLoad and compare different schedulersLoad community pipelinesLoad safetensorsLoad different Stable Diffusion formatsPush files to the Hub
Pipelines for Inference
OverviewUnconditional image generationText-to-image generationText-guided image-to-imageText-guided image-inpaintingText-guided depth-to-imageTextual inversionDistributed inference with multiple GPUsDistilled Stable Diffusion inferenceImprove image quality with deterministic generationControl image brightnessCreate reproducible pipelinesCommunity pipelinesHow to contribute a community pipelineStable Diffusion in JAX/FlaxPrompt weighting
Training
OverviewCreate a dataset for trainingAdapt a model to a new taskUnconditional image generationTextual InversionDreamBoothText-to-imageLow-Rank Adaptation of Large Language Models (LoRA)ControlNetInstructPix2Pix TrainingCustom Diffusion
Taking Diffusers Beyond Images
Optimization/Special Hardware
Conceptual Guides
PhilosophyControlled generationHow to contribute?Diffusers' Ethical GuidelinesEvaluating Diffusion Models
API
Main Classes
Models
OverviewUNet1DModelUNet2DModelUNet2DConditionModelUNet3DConditionModelVQModelAutoencoderKLAsymmetricAutoencoderKLTiny AutoEncoderTransformer2DTransformer TemporalPrior TransformerControlNet
Pipelines
OverviewAltDiffusionAttend-and-ExciteAudio DiffusionAudioLDMAutoPipelineConsistency ModelsControlNetControlNet with Stable Diffusion XLCycle DiffusionDance DiffusionDDIMDDPMDeepFloyd IFDiffEditDiTInstructPix2PixKandinskyKandinsky 2.2Latent DiffusionMultiDiffusionPaintByExampleParallel Sampling of Diffusion ModelsPix2Pix ZeroPNDMRePaintScore SDE VESelf-Attention GuidanceSemantic GuidanceShap-ESpectrogram Diffusion
Stable Diffusion
OverviewText-to-imageImage-to-imageInpaintingDepth-to-imageImage variationSafe Stable DiffusionStable Diffusion 2Stable Diffusion XLLatent upscalerSuper-resolutionLDM3D Text-to-(RGB, Depth)Stable Diffusion T2I-adapterGLIGEN (Grounded Language-to-Image Generation)
Stable unCLIPStochastic Karras VEText-to-image model editingText-to-videoText2Video-ZeroUnCLIPUnconditional Latent DiffusionUniDiffuserValue-guided samplingVersatile DiffusionVQ DiffusionSchedulers
OverviewCMStochasticIterativeSchedulerDDIMInverseSchedulerDDIMSchedulerDDPMSchedulerDEISMultistepSchedulerDPMSolverMultistepInverseDPMSolverMultistepSchedulerDPMSolverSDESchedulerDPMSolverSinglestepSchedulerEulerAncestralDiscreteSchedulerEulerDiscreteSchedulerHeunDiscreteSchedulerIPNDMSchedulerKarrasVeSchedulerKDPM2AncestralDiscreteSchedulerKDPM2DiscreteSchedulerLMSDiscreteSchedulerPNDMSchedulerRePaintSchedulerScoreSdeVeSchedulerScoreSdeVpSchedulerUniPCMultistepSchedulerVQDiffusionScheduler
You are viewing v0.20.0 version. A newer version v0.38.0 is available.
Using Diffusers with other modalities
Diffusers is in the process of expanding to modalities other than images.
| Example type | Colab | Pipeline |
|---|---|---|
| Molecule conformation generation | ❌ |
More coming soon!