Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesis
Enhances performance in diffusion models through Trajectory Segmented Consistency Distillation, human feedback learning, and score distillation
The Hyper-SD framework represents a significant advancement in the field of diffusion models, particularly in maximizing their few-step generation capacity. By synergistically integrating trajectory-segmented consistency distillation, human feedback learning, and variational score distillation, Hyper-SD achieves state-of-the-art performance based on SDXL and SD1.5 architectures.
The cornerstone of the framework lies in trajectory-segmented consistency distillation, which enhances trajectory preservation during distillation, resulting in improved generation proficiency. This innovative approach ensures that the generated models maintain high-quality trajectories, approaching the proficiency level of the original model.
Human feedback learning and variational score distillation further optimize the trajectory for generating models efficiently in a few steps. By leveraging these techniques, the framework enhances the potential for few-step inference, ultimately leading to the production of high-quality images with minimal inference steps.
Moreover, the framework includes LoRA plugins compatible with SDXL and SD1.5 architectures, offering inference capabilities ranging from 1 to 8 steps. This comprehensive implementation, along with a dedicated one-step SDXL model, contributes to the advancement of the generative AI community by providing tools for accelerating diffusion models and achieving superior performance in image generation tasks.
Comments
None