diffusers 需升级到 >=0.32.0 才能使用 SanaPipeline;推理示例通过 hf:// 从 HuggingFace 拉取权重,需联网下载模型;视频推理需按脚本传入 config 与 model_path 参数,不能直接跑默认命令。

Sana
NVlabsApache-2.0活跃维护SANA 是英伟达开源的高效扩散生成模型与配套训练推理引擎,支持文生图、文生视频和世界模型,用线性注意力和 NVFP4 量化在低显存下实现快速生成。
SANA & Sol: Efficient Generative Models and Full-Stack Training & Inference Engines for Image, Video, and World Modeling
git clone https://github.com/NVlabs/Sana.git
cd Sana && ./environment_setup.sh sanaREADME 未统一说明显存要求;Demo 徽章显示 6x3090 可跑 SANA、1x3090 可跑 4bit 与 ControlNet 版本,Sol-H3 可在单张 RTX 5090 或 DGX Spark 上运行。
NVIDIA 开源的高效图像视频生成模型库,含完整训练与推理流水线
SANA 是英伟达开源的高效扩散生成模型与配套训练推理引擎,支持文生图、文生视频和世界模型,用线性注意力和 NVFP4 量化在低显存下实现快速生成。
核心能力
- 提供 SANA 系列 0.6B~4.8B 图像生成模型及训练推理代码
- 支持 SANA-Video 2.0 文生视频与图文生视频,720p 输出
- 内置 SANA-Sprint 少步蒸馏、ControlNet、LoRA/DreamBooth 微调
- 提供 4bit/8bit 量化推理与 diffusers 集成
- 附带 Sol-RL 后训练与 Sol Engine 推理加速分支
容易踩的坑
- streamrender-h3-examples-v1StreamRender-H3 curated racing examples最新正式版2026-10-11 · 2026-10-11 10:14 UTC
StreamRender-H3 curated racing examples
60 reference-video render requests: 20 scenes in group A and 10 trajectories with four appearance variants each in group B. Default: B10_e-track-3_bluehour.
The archive contains 30 semantic videos and 60 reference pictures, plus a SHA-256 inventory. Extract it from models/streamrender_h3 to populate examples/media/. Request JSONLs and usage instructions are in the sol-engine branch under models/streamrender_h3/examples/.
Checkpoint download: https://huggingface.co/yitongl/StreamRender-H3
Usage: https://github.com/NVlabs/Sana/tree/sol-engine/models/streamrender_h3/examples
These are prerecorded input examples, not generated output videos or action transcripts. Contributor permission covers publication of this material; upstream model and third-party game asset licenses remain applicable.
- v2.0.0SANA-Video && SANA-WM2026-06-09 · 2026-06-09 06:37 UTC
查看更新说明
What's Changed
- fix bugs and update inference examples; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/217
- [fix bug] debug mode during training by @lawrence-cj in https://github.com/NVlabs/Sana/pull/220
- Adding svdquant required model type conversion script by @lawrence-cj in https://github.com/NVlabs/Sana/pull/222
- Fix args.image_size by @yujincheng08 in https://github.com/NVlabs/Sana/pull/223
- fix dead lock during training by @lawrence-cj in https://github.com/NVlabs/Sana/pull/224
- fix dataloader deadlock bug by @lawrence-cj in https://github.com/NVlabs/Sana/pull/225
- [ctrlnet] fix gradio by @yujincheng08 in https://github.com/NVlabs/Sana/pull/229
- Recovery inference CI test by @lawrence-cj in https://github.com/NVlabs/Sana/pull/230
- change gemma-2-2b-it path; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/231
- add 0.6B Sana-Sprint model path by @lawrence-cj in https://github.com/NVlabs/Sana/pull/234
- code update; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/237
- fix config path in README.md by @dotneet in https://github.com/NVlabs/Sana/pull/238
- fix bugs and update readme by @lawrence-cj in https://github.com/NVlabs/Sana/pull/245
- Fix a bug in FSDP checkpoint loading by @HeliosZhao in https://github.com/NVlabs/Sana/pull/247
- [fix] fix bugs in conversion to diffusers script by @lawrence-cj in https://github.com/NVlabs/Sana/pull/248
- Support SANA-1.5 in ComfyUI by @lawrence-cj in https://github.com/NVlabs/Sana/pull/249
- Refine gradio by @yujincheng08 in https://github.com/NVlabs/Sana/pull/262
- Nv labs GitHub repo by @lawrence-cj in https://github.com/NVlabs/Sana/pull/275
- fix diffusers model path in readme by @ashawkey in https://github.com/NVlabs/Sana/pull/263
- add reference code for sana-sprint by @lawrence-cj in https://github.com/NVlabs/Sana/pull/277
- Merge from ELM/main by @lawrence-cj in https://github.com/NVlabs/Sana/pull/281
- Update README.md to include ICCV acceptance by @sayakpaul in https://github.com/NVlabs/Sana/pull/292
- fix link in README.md by @sihyeong671 in https://github.com/NVlabs/Sana/pull/288
- Fixed Sana Sprint 0.6b config for train_scm_ladd by @CookedMorsel in https://github.com/NVlabs/Sana/pull/287
- Use js to select gallery by @yujincheng08 in https://github.com/NVlabs/Sana/pull/295
- support dc-ae-turbo by @chenjy2003 in https://github.com/NVlabs/Sana/pull/298
- Update DC-AE-Lite by @lawrence-cj in https://github.com/NVlabs/Sana/pull/299
- Sana Inpainting Feature by @Cedric-Perauer in https://github.com/NVlabs/Sana/pull/296
- Update README by @lawrence-cj in https://github.com/NVlabs/Sana/pull/305
- [SANA-Video] Adding SANA-Video Training & Inference code & Dataloader and so on by @lawrence-cj in https://github.com/NVlabs/Sana/pull/313
- add cover by @lawrence-cj in https://github.com/NVlabs/Sana/pull/315
- SANA-Video PR is under construction by @lawrence-cj in https://github.com/NVlabs/Sana/pull/321
- Support Image2Video inference; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/324
- Upload SANA-Video Introduction Video by @lawrence-cj in https://github.com/NVlabs/Sana/pull/326
- add
SanaImageToVideoPipelineimage-to-video in diffusers pipeline by @lawrence-cj in https://github.com/NVlabs/Sana/pull/331 - Fixed checkpoint load & save bugs by @CookedMorsel in https://github.com/NVlabs/Sana/pull/334
- update readme; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/336
- LongSANA: support SANA-Video + LongLive by @HeliosZhao in https://github.com/NVlabs/Sana/pull/341
- New online docs sys by @lawrence-cj in https://github.com/NVlabs/Sana/pull/346
- Fix docs bug by @lawrence-cj in https://github.com/NVlabs/Sana/pull/347
- Fix docs bug; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/348
- fix minor docs bug; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/349
- add image by @lawrence-cj in https://github.com/NVlabs/Sana/pull/350
- update rea
- v1.5.0SANA-1.5 && SANA-Sprint2025-03-25 · 2025-03-25 03:17 UTC
查看更新说明
What's Changed
- Inference with lower VRAM requirements by @frutiemax92 in https://github.com/NVlabs/Sana/pull/18
- Fix config loading for jupyter environments by @odusseys in https://github.com/NVlabs/Sana/pull/30
- Fix Dockerfile by @JimothyJohn in https://github.com/NVlabs/Sana/pull/34
- Relative import xformer triton depend fix by @lawrence-cj in https://github.com/NVlabs/Sana/pull/37
- remove triton dependency of DC-AE and fix bugs; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/38
- Refine gradio by @yujincheng08 in https://github.com/NVlabs/Sana/pull/39
- fix the bug of stop training around 4 hours. by @lawrence-cj in https://github.com/NVlabs/Sana/pull/66
- add comfyui related files by @lawrence-cj in https://github.com/NVlabs/Sana/pull/77
- add a T2I2V video link into comfyui readme by @lawrence-cj in https://github.com/NVlabs/Sana/pull/78
-
diffuserssupport Sana; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/88
- receive any kinds of image extension in
SanaImgDataset; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/94 - add Sana-LoRA training and guidance by @lawrence-cj in https://github.com/NVlabs/Sana/pull/98
-
- update for 2Kpx models release; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/103
- add config file for 2K models; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/104
- update code for better quality by @lawrence-cj in https://github.com/NVlabs/Sana/pull/105
- fix the sample num bug in inference. by @lawrence-cj in https://github.com/NVlabs/Sana/pull/108
- Nv labs GitHub repo/nv labs GitHub repo main by @lawrence-cj in https://github.com/NVlabs/Sana/pull/124
- fix the bug when resume rng_state with diffuerent gpu numbers. by @lawrence-cj in https://github.com/NVlabs/Sana/pull/131
- support 4K images by @lawrence-cj in https://github.com/NVlabs/Sana/pull/135
- [Tool]ImgDataset2WebDatasetMS by @Pevernow in https://github.com/NVlabs/Sana/pull/130
- fix 4K OOM with VAE-tiling by @lawrence-cj in https://github.com/NVlabs/Sana/pull/144
- docs: update README.md by @eltociear in https://github.com/NVlabs/Sana/pull/151
- fix: correct CSS property & missing articles by @CharlesCNorton in https://github.com/NVlabs/Sana/pull/152
- fix the bug for
AutoencoderDCencode training; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/158 - Nv labs GitHub repo/nv labs GitHub repo main by @lawrence-cj in https://github.com/NVlabs/Sana/pull/163
- update CI script; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/165
- Sana1.5 8 bit CAME optimizer code release by @lawrence-cj in https://github.com/NVlabs/Sana/pull/167
- Nv labs GitHub repo/nv labs GitHub repo main adding controlnet (#23) by @lawrence-cj in https://github.com/NVlabs/Sana/pull/177
- update README by @lawrence-cj in https://github.com/NVlabs/Sana/pull/195
- SANA-1.5 && FSDP training code by @lawrence-cj in https://github.com/NVlabs/Sana/pull/196
- inference scaling update by @hills-code in https://github.com/NVlabs/Sana/pull/208
- Merging SANA-Sprint release code by @lawrence-cj in https://github.com/NVlabs/Sana/pull/198
- add a guidance to explore; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/212
- update diffusers conversion script; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/213
New Contributors
- @frutiemax92 made their first contribution in https://github.com/NVlabs/Sana/pull/18
- @odusseys made their first contribution in https://github.com/NVlabs/Sana/pull/30
- @JimothyJohn made their first contribution in https://github.com/NVlabs/Sana/pull/34
- @lawrence-cj made their first contribution in https://github.com/NVlabs/Sana/pull/37
- @yujincheng08 made their first contribution in https://github.com/NVlabs/Sana/pull/39
- @Pevernow made their first contribution in https://github.com/NVlabs/Sana/pull/130
- @eltociear made their first contribution in https://github.com/NVlabs/Sana/pull/151
- @CharlesCNorton made their first contribu
- v1.0.0SANA-1.0pre-release2025-03-25 · 2025-03-25 03:16 UTC
查看更新说明
What's Changed
- Inference with lower VRAM requirements by @frutiemax92 in https://github.com/NVlabs/Sana/pull/18
- Fix config loading for jupyter environments by @odusseys in https://github.com/NVlabs/Sana/pull/30
- Fix Dockerfile by @JimothyJohn in https://github.com/NVlabs/Sana/pull/34
- Relative import xformer triton depend fix by @lawrence-cj in https://github.com/NVlabs/Sana/pull/37
- remove triton dependency of DC-AE and fix bugs; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/38
- Refine gradio by @yujincheng08 in https://github.com/NVlabs/Sana/pull/39
- fix the bug of stop training around 4 hours. by @lawrence-cj in https://github.com/NVlabs/Sana/pull/66
- add comfyui related files by @lawrence-cj in https://github.com/NVlabs/Sana/pull/77
- add a T2I2V video link into comfyui readme by @lawrence-cj in https://github.com/NVlabs/Sana/pull/78
-
diffuserssupport Sana; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/88
- receive any kinds of image extension in
SanaImgDataset; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/94 - add Sana-LoRA training and guidance by @lawrence-cj in https://github.com/NVlabs/Sana/pull/98
-
- update for 2Kpx models release; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/103
- add config file for 2K models; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/104
- update code for better quality by @lawrence-cj in https://github.com/NVlabs/Sana/pull/105
- fix the sample num bug in inference. by @lawrence-cj in https://github.com/NVlabs/Sana/pull/108
- Nv labs GitHub repo/nv labs GitHub repo main by @lawrence-cj in https://github.com/NVlabs/Sana/pull/124
- fix the bug when resume rng_state with diffuerent gpu numbers. by @lawrence-cj in https://github.com/NVlabs/Sana/pull/131
- support 4K images by @lawrence-cj in https://github.com/NVlabs/Sana/pull/135
- [Tool]ImgDataset2WebDatasetMS by @Pevernow in https://github.com/NVlabs/Sana/pull/130
- fix 4K OOM with VAE-tiling by @lawrence-cj in https://github.com/NVlabs/Sana/pull/144
- docs: update README.md by @eltociear in https://github.com/NVlabs/Sana/pull/151
- fix: correct CSS property & missing articles by @CharlesCNorton in https://github.com/NVlabs/Sana/pull/152
- fix the bug for
AutoencoderDCencode training; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/158 - Nv labs GitHub repo/nv labs GitHub repo main by @lawrence-cj in https://github.com/NVlabs/Sana/pull/163
- update CI script; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/165
- Sana1.5 8 bit CAME optimizer code release by @lawrence-cj in https://github.com/NVlabs/Sana/pull/167
- Nv labs GitHub repo/nv labs GitHub repo main adding controlnet (#23) by @lawrence-cj in https://github.com/NVlabs/Sana/pull/177
- update README by @lawrence-cj in https://github.com/NVlabs/Sana/pull/195
- SANA-1.5 && FSDP training code by @lawrence-cj in https://github.com/NVlabs/Sana/pull/196
- inference scaling update by @hills-code in https://github.com/NVlabs/Sana/pull/208
- Merging SANA-Sprint release code by @lawrence-cj in https://github.com/NVlabs/Sana/pull/198
- add a guidance to explore; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/212
- update diffusers conversion script; by @lawrence-cj in https://github.com/NVlabs/Sana/pull/213
New Contributors
- @frutiemax92 made their first contribution in https://github.com/NVlabs/Sana/pull/18
- @odusseys made their first contribution in https://github.com/NVlabs/Sana/pull/30
- @JimothyJohn made their first contribution in https://github.com/NVlabs/Sana/pull/34
- @lawrence-cj made their first contribution in https://github.com/NVlabs/Sana/pull/37
- @yujincheng08 made their first contribution in https://github.com/NVlabs/Sana/pull/39
- @Pevernow made their first contribution in https://github.com/NVlabs/Sana/pull/130
- @eltociear made their first contribution in https://github.com/NVlabs/Sana/pull/151
- @CharlesCNorton made their first contribu
用户点评
登录用户的真实使用记录,可按版本和硬件筛选还没有人点评。第一个说出真实体验的人最有价值。
Demo | 🎬 SANA-Video 2.0 Demo | 🤗 HuggingFace | ComfyUI | SGLang | Cosmos-RL
SANA is an efficiency-oriented codebase for high-resolution image and video generation, providing complete training and inference pipelines. This repository contains code for SANA, SANA-1.5, SANA-Sprint, SANA-Video, SANA-Video 2.0, SANA-WM, SANA-Streaming, and Sol-RL. More details can be found in our 📚 documentation.
Join our Discord to engage in discussions with the community! If you have any questions, run into issues, or are interested in contributing, don't hesitate to reach out!
News
- 🔥 [2026/10] 🎮 StreamRender-H3 is released! A code-driven streaming render runtime connecting a controllable Three.js game engine to a multi-GPU H3 streaming renderer with browser video feedback. See Project | Code.
- 🔥 [2026/10] ⚡ Sol-H3 brings MiniMax-H3 to a single RTX 5090 or DGX Spark, now also in ComfyUI: one 1344×768 clip with audio in 35.5 s on one RTX 5090 (989.0 s for the original 50-step model). See Project | Code.
- 🔥 [2026/09] 🔍 SoL-Refiner is released! One-step refinement turns low-resolution video drafts into high-resolution video, with code and models for LTX-2.3 and MiniMax-H3. See Project | Code.
- 🔥 [2026/09] ⚡ SANA-Video 2.0 5B 4-Step Preview is released! The DMD preview generates 720p videos in four denoising steps and supports 5-second and 8-second outputs. See Online Demo | 4-Step Weights | Doc | Project.
- 🔥 [2026/08] 🎬 SANA-Video 2.0 training, inference, model architecture, and 5B 720p checkpoint are released! The 8-second model supports both text-to-video and text-image-to-video generation, with hybrid linear/softmax attention and Attention Residuals. See Online Demo | Project | Doc | Model Zoo | Weights.
- 🔥 [2026/08] ⚡ Sol Engine: Day-One MiniMax-H3 Acceleration is available! The 33B omni-modal audio+video DiT runs 3.95× faster on GB200, reached in 4.5 hours of optimization, and up to 4.52× on hardware that sits on a desk — 3.92× on DGX Spark, 4.52× on GeForce RTX 5090 — with no distillation, no LoRA, and no calibration pass. See GB200 Blog | On-Device Blog.
- 🔥 [2026/07] 🌍 SANA-Streaming training is released! Includes bidirectional and distillation training. See Doc.
- 🔥 [2026/07] 🌍 SANA-WM Stage-1 training is released! Includes bidirectional, chunk-causal, and distillation training. See Doc.
- 🔥 [2026/06] 🎬 SANA-Streaming: 2B Model for Real-time Streaming Editing is released! Supports 720p, 1-min video editing. A pioneer work for streaming editing. See Project | Doc | Paper | Reactor Demo.
- 🔥 [2026/05] 🌍 SANA-WM: 2.6B Controllable World Model is released! Supports 720p, 1-min video generation with 6-DoF camera control. A new baseline for World Modeling and Embodied AI. See Project | Doc | Paper | Reactor Demo.
- 🔥 [2026/04] ⚡ Sol-RL: NVFP4 Rollout, BF16 Training RL is available! All training recipes for SANA, FLUX.1, and SD3.5-L, together with bundled post-training datasets, are released. See Sol-RL doc | Page | Paper.
- 🔥 [2026/03] 📺 SANA-Video 720p model with LTX-VAE is released. Use it with LTX2 Refiner to upscale the videos to 2K resolution! See Model Zoo, SANA-Video doc and Blog about refiner.
- 🔥 [2026/03] 💪 Post Training Infra: SANA × Cosmos-RL — We partner with Cosmos-RL to provide a complete RL infrastructure for SANA. You can now post-train (SFT/RL) SANA-Image and SANA-Video with state-of-the-art algorithms (e.g. Diffusion-NFT, Flow-GRPO), preset configs, reward services, and flexible datasets. See SANA on Cosmos-RL and our Cosmos-RL integration doc.
- 🔥 [2026/02] 🚀 SANA is now supported in SGLang! High-performance serving with OpenAI-compatible API. [Guidance]
- 🔥 [2026/01/26] SANA-Video is accepted as Oral by ICLR-2026. 🎉🎉🎉
- 🔥 [2025/12/09] 🎬 LongSANA: 27FPS real-time minute-length video generation model, training and inference code are all released. Thanks to LongLive Team. Refer to: [Train] | [Test] | [Weight]
- 🔥 [2025/11/24] 🪶 Blog: how Causal Linear Attention unlocks infinite context for LLMs and long video generation.
- 🔥 [2025/11/9] 🎬 Introduction video shows how Block Causal Linear Attention and Causal Mix-FFN work?
- 🔥 [2025/11/6] 📺SANA-Video is merged into diffusers. How to use.
- 🔥 [2025/10/27] 📺SANA-Video is released. [README] | [Weights] support Text-to-Video, TextImage-to-Video.
- 🔥 [2025/10/13] 📺SANA-Video is coming, 1). a 5s Linear DiT Video model, and 2). real-time minute-length video generation (with LongLive). [paper] | [Page]
- ✅ [2025/8/20] We release a new DC-AE-Lite for faster inference and smaller memory. [How to config] | [diffusers PR] | [Weight]
- ✅ [2025/6/25] SANA-Sprint was accepted to ICCV'25 🏖️
- ✅ [2025/6/4] SANA-Sprint ComfyUI Node is released [Example].
- ✅ [2025/5/8] SANA-Sprint (One-step diffusion) diffusers training code is released [Guidance].
- ✅ [2025/5/4] SANA-1.5 (Inference-time scaling) is accepted by ICML-2025. 🎉🎉🎉
- ✅ [2025/3/22] 🔥SANA-Sprint demo is hosted on Huggingface, try it! 🎉 [Demo Link]
- ✅ [2025/3/22] 🔥SANA-1.5 is supported in ComfyUI! 🎉: ComfyUI Guidance | ComfyUI Work Flow SANA-1.5 4.8B
- ✅ [2025/3/22] 🔥SANA-Sprint code & weights are released! 🎉 Include: Training & Inference code and Weights / HF are all released. [Guidance]
- ✅ [2025/3/21] 🚀Sana + Inference Scaling is released. [Guidance]
- ✅ [2025/3/16] 🔥SANA-1.5 code & weights are released! 🎉 Include: DDP/FSDP | TAR file WebDataset | Multi-Scale Training code and Weights | HF are all released.
- ✅ [2025/3/14] 🏃SANA-Sprint is coming out! 🎉 A new one/few-step generator of Sana. 0.1s per 1024px image on H100, 0.3s on RTX 4090. Find out more details: [Page] | [Arxiv]. Code is coming very soon along with
diffusers - ✅ [2025/2/10] 🚀Sana + ControlNet is released. [Guidance] | [Model] | [Demo]
- ✅ [2025/1/30] Release CAME-8bit optimizer code. Saving more GPU memory during training. [How to config]
- ✅ [2025/1/29] 🎉 🎉 🎉SANA 1.5 is out! Figure out how to do efficient training & inference scaling! 🚀[Tech Report]
- ✅ [2025/1/24] 4bit-Sana is released, powered by SVDQuant and Nunchaku inference engine. Now run your Sana within 8GB GPU VRAM [Guidance] [Demo] [Model]
- ✅ [2025/1/24] DCAE-1.1 is released, better reconstruction quality. [Model] [diffusers]
- ✅ [2025/1/23] Sana is accepted as Oral by ICLR-2025. 🎉🎉🎉
- ✅ [2025/1/12] DC-AE tiling makes Sana-4K inferences 4096x4096px images within 22GB GPU memory. With model offload and 8bit/4bit quantize. The 4K Sana run within 8GB GPU VRAM. [Guidance]
- ✅ [2025/1/11] Sana code-base license changed to Apache 2.0.
- ✅ [2025/1/10] Inference Sana with 8bit quantization.[Guidance]
- ✅ [2025/1/8] 4K resolution Sana models is supported in Sana-ComfyUI and work flow is also prepared. [4K guidance]
- ✅ [2025/1/8] 1.6B 4K resolution Sana models are released: [BF16 pth] or [BF16 diffusers]. 🚀 Get your 4096x4096 resolution images within 20 seconds! Find more samples in Sana page. Thanks SUPIR for their wonderful work and support.
- ✅ [2025/1/2] Bug in the
diffuserspipeline is solved. Solved PR - ✅ [2025/1/2] 2K resolution Sana models is supported in Sana-ComfyUI and work flow is also prepared.
- ✅ [2024/12] 1.6B 2K resolution Sana models are released: [BF16 pth] or [BF16 diffusers]. 🚀 Get your 2K resolution images within 4 seconds! Find more samples in Sana page. Thanks SUPIR for their wonderful work and support.
- ✅ [2024/12]
diffuserssupports Sana-LoRA fine-tuning! Sana-LoRA's training and convergence speed is super fast. [Guidance] or [diffusers docs]. - ✅ [2024/12]
diffusershas Sana! All Sana models in diffusers safetensors are released and diffusers pipelineSanaPipeline,SanaPAGPipeline,DPMSolverMultistepScheduler(with FlowMatching)are all supported now. We prepare a Model Card for you to choose. - ✅ [2024/12] 1.6B BF16 Sana model is released for stable fine-tuning.
- ✅ [2024/12] We release the ComfyUI node for Sana. [Guidance]
- ✅ [2024/11] All multi-linguistic (Emoji & Chinese & English) SFT models are released: 1.6B-512px, 1.6B-1024px, 600M-512px, 600M-1024px. The metric performance is shown here
- ✅ [2024/11] Sana Replicate API is launching at Sana-API.
- ✅ [2024/11] 1.6B Sana models are released.
- ✅ [2024/11] Training & Inference & Metrics code are released.
- ✅ [2024/11] Working on
diffusers. - [2024/10] Demo is released.
- [2024/10] DC-AE Code and weights are released!
- [2024/10] Paper is on Arxiv!
💡 Introduction
We introduce SANA, a series of efficient diffusion models for high-resolution image and video generation:
- SANA: Text-to-image generation up to 4K resolution, 20× smaller and 100× faster than Flux-12B.
- SANA-1.5: Efficient training-time and inference-time compute scaling for better quality.
- SANA-Sprint: One/few-step generation via sCM distillation, 0.1s per 1024px image on H100.
- SANA-Video/LongSANA: Efficient video generation with Block Linear Attention / with LongLive.
- SANA-Video 2.0: 5B and 14B text-to-video/text-image-to-video architectures with hybrid linear/softmax attention and Attention Residuals. Try the 5B 720p 4-step preview, or download the 50-step and 4-step preview checkpoints; the 14B config and checkpoint are not included yet.
- Sol-RL: NVFP4 Rollout, BF16 Training RL achieves 4.64× faster convergence.
- SANA-WM: 2.6B parameter controllable world model, generating 720p, 1-minute video worlds with 6-DoF camera control.
- SANA-Streaming: 2B real-time streaming video-to-video editing for 720p, minute-scale videos.
Key Techniques:
- Linear Attention: Replace vanilla attention in DiT with linear attention for efficiency at high resolutions.
- DC-AE: 32× image compression (vs. traditional 8×) to reduce latent tokens.
- Decoder-only Text Encoder: Modern decoder-only LLM with in-context learning for better text-image alignment.
- Block Causal Linear Attention & Causal Mix-FFN: Efficient attention and feedforward for long video generation.
- Hybrid Attention & Attention Residuals: Combine gated linear attention with periodic softmax anchors and shared depth-wise residual aggregation.
- Flow-DPM-Solver: Reduce sampling steps with efficient training and sampling.
- sCM Distillation: One/few-step generation with continuous-time consistency distillation.
- Sol-RL: Low precision(NVFP4) rollout selection, high precesion(BF16) optimization for faster RL training.
- Controllable World Modeling: Efficient long-context modeling and camera trajectory control for consistent world generation.
- Streaming Video Editing: Real-time long-form video-to-video editing with stable temporal consistency.
In summary, SANA is a fully open-source framework integrating efficient training, fast inference, and flexible deployment for both image and video generation. Deployable on laptop GPUs with < 8GB VRAM via 4-bit quantization.
Quick Start
git clone https://github.com/NVlabs/Sana.git
cd Sana && ./environment_setup.sh sana
SANA-Video 2.0 5B release demo
Try your own prompt in the SANA-Video 2.0 5B 720p 4-step preview, or reproduce this 50-step sample (seed 4, 193 frames at 24 FPS):
bash inference_video_scripts/inference_sana_video.sh \
--np 1 \
--config configs/sana_video2/SanaVideo2_5B_720p.yaml \
--model_path hf://Efficient-Large-Model/SANA-Video_2.0_5B_720p/checkpoints/SANA_Video_2.0_5B_720p.pth \
--txt_file=asset/samples/sana_video2_5b_720p_demo.txt \
--cfg_scale 8 \
--flow_shift 12 \
--step 50 \
--fps 24 \
--motion_score 20 \
--seed 4 \
--work_dir output/sana_video2_t2v_720p_demo
The four-step preview command and more examples are in the SANA-Video 2.0 guide.
Inference with 🧨 diffusers
import torch
from diffusers import SanaPipeline
pipe = SanaPipeline.from_pretrained(
"Efficient-Large-Model/SANA1.5_1.6B_1024px_diffusers",
torch_dtype=torch.bfloat16,
)
pipe.to("cuda")
pipe.vae.to(torch.bfloat16)
pipe.text_encoder.to(torch.bfloat16)
prompt = 'a cyberpunk cat with a neon sign that says "Sana"'
image = pipe(
prompt=prompt,
height=1024,
width=1024,
guidance_scale=4.5,
num_inference_steps=20,
generator=torch.Generator(device="cuda").manual_seed(42),
)[0]
image[0].save("sana.png")
[!TIP] Upgrade your
diffusers>=0.32.0to useSanaPipeline. More details can be found in 📚 Docs.
Getting Started
- 📚 Full Documentation
- Installation Guide
- Model Zoo
- Sana Inference & Training
- SANA-Sprint
- SANA-Video
- SANA-Video 2.0
- LongSANA
- SANA-WM
- SANA-Streaming
- ControlNet
- LoRA / DreamBooth
- Sol-RL Post-Training
- Quantization (4bit / 8bit)
- ComfyUI
- SGLang
Performance
Image Generation (1024px)
| Methods (1024x1024) | Throughput (samples/s) | Latency (s) | Params (B) | Speedup | FID 👇 | CLIP 👆 | GenEval 👆 | DPG 👆 |
|---|---|---|---|---|---|---|---|---|
| FLUX-dev | 0.04 | 23.0 | 12.0 | 1.0× | 10.15 | 27.47 | 0.67 | 84.0 |
| Sana-0.6B | 1.7 | 0.9 | 0.6 | 39.5× | 5.81 | 28.36 | 0.64 | 83.6 |
| Sana-0.6B | 1.7 | 0.9 | 0.6 | 39.5× | 5.61 | 28.80 | 0.68 | 84.2 |
| Sana-1.6B | 1.0 | 1.2 | 1.6 | 23.3× | 5.92 | 28.94 | 0.69 | 84.5 |
| Sana-1.5 1.6B | 1.0 | 1.2 | 1.6 | 23.3× | 5.70 | 29.12 | 0.82 | 84.5 |
| Sana-1.5 4.8B | 0.26 | 4.2 | 4.8 | 6.5× | 5.99 | 29.23 | 0.81 | 84.7 |
Video Generation (VBench)
| Models | Evaluation setting | Latency (s) | Params (B) | VBench Total ↑ | Quality ↑ | Semantic ↑ |
|---|---|---|---|---|---|---|
| Wan-2.1-14B | 720p | 1897 | 14 | 83.73 | 85.77 | 75.58 |
| Wan-2.1-1.3B | 720p | 400 | 1.3 | 83.38 | 85.67 | 74.22 |
| SANA-Video-2B | 720p | 36 | 2 | 84.05 | 84.63 | 81.73 |
| SANA-Video 2.0 5B | 480×832×81 | 13.2 | 5 | 84.30 | 85.61 | 79.05 |
SANA-Video 2.0 results follow the paper's 40-step, single-H100 VBench protocol. At 736×1280×81, its end-to-end latency is 30.9 seconds on one H100.
💪To-Do List
We will try our best to achieve
- [✅] Training code
- [✅] Inference code
- [✅] Model zoo
- [✅] ComfyUI Nodes(SANA, SANA-1.5, SANA-Sprint)
- [✅] DC-AE Diffusers
- [✅] Sana merged in Diffusers(https://github.com/huggingface/diffusers/pull/9982)
- [✅] LoRA training by @paul(
diffusers: https://github.com/ huggingface/diffusers/pull/10234) - [✅] 2K/4K resolution models.(Thanks @SUPIR to provide a 4K super-resolution model)
- [✅] 8bit / 4bit Laptop development
- [✅] ControlNet (train & inference & models)
- [✅] FSDP Training
- [✅] SANA-1.5 (Larger model size / Inference Scaling)
- [✅] SANA-Sprint: Few-step generator
- [✅] Faster DCAE-Lite weight
- [✅] Better re-construction F32/F64 VAEs
- [✅] SANA-Video: Linear DiT Video model, and real-time minute-length video generation
- [✅] SANA-Video 2.0 training, inference, and 5B/14B model architecture
- [✅] SANA-Video 2.0 5B 720p weights
- [✅] RL Post-training: collaborate with Cosmos-RL
- [✅] SANA World Model
- [✅] SANA-Streaming Video-to-Video Editing
- [🚀] See you in the future
🤗 Acknowledgements
Thanks to the following open-sourced projects:
Thanks to the following open-sourced codebase for their wonderful work and codebase!
- PixArt-α
- PixArt-Σ
- diffusers
- Efficient-ViT
- ComfyUI_ExtraModels
- SVDQuant and Nunchaku
- Open-Sora
- Wan
- LTX-2
- LongLive
- Cosmos-RL
- Sol-Engine
Thanks Paper2Video for generating Jeason presenting SANA😊. Refer to Paper2Video for more details.
Contribution
Thanks go to these wonderful contributors:
🌟 Star History
📖 BibTeX
@misc{xie2024sana,
title={Sana: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer},
author={Enze Xie and Junsong Chen and Junyu Chen and Han Cai and Haotian Tang and Yujun Lin and Zhekai Zhang and Muyang Li and Ligeng Zhu and Yao Lu and Song Han},
year={2024},
eprint={2410.10629},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2410.10629},
}
@misc{xie2025sana,
title={SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformer},
author={Xie, Enze and Chen, Junsong and Zhao, Yuyang rectangle and Yu, Jincheng and Zhu, Ligeng and Lin, Yujun and Zhang, Zhekai and Li, Muyang and Chen, Junyu and Cai, Han and others},
year={2025},
eprint={2501.18427},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2501.18427},
}
@misc{chen2025sanasprint,
title={SANA-Sprint: One-Step Diffusion with Continuous-Time Consistency Distillation},
author={Junsong Chen and Shuchen Xue and Yuyang Zhao and Jincheng Yu graves and Sayak Paul and Junyu Chen and Han Cai and Song Han and Enze Xie},
year={2025},
eprint={2503.09641},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2503.09641},
}
@misc{chen2025sanavideo,
title={SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformer},
author={Chen, Junsong and Zhao, Yuyang and Yu, Jincheng and Chu, Ruihang and Chen, Junyu and Yang, Shuai and Wang, Xianbang and Pan, Yicheng and Zhou, Daquan and Ling, Huan and others},
year={2025},
eprint={2509.24695},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2509.24695},
}
@misc{chen2026sanavideo2,
title={SANA-Video 2.0: Hybrid Linear Attention with Attention Residuals for Efficient Video Generation},
author={Junsong Chen and Jincheng Yu and Yitong Li and Shuchen Xue and Haozhe Liu and Jingyu Xin and Yuyang Zhao and Tian Ye and Zhangjie Wu and Zian Wang and Daquan Zhou and Ping Luo and Song Han and Enze Xie},
year={2026},
eprint={2607.21553},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2607.21553},
}
@misc{li2026fp4,
title={FP4 Explore, BF16 Train: Diffusion Reinforcement Learning via Efficient Rollout Scaling},
author={Li, Yitong and Chen, Junsong and Xue, Shuchen and Zeren, Pengcuo and Fu, Siyuan and Yang, Dinghao and Tang, Yangyang and Bai, Junjie and Luo, Ping and Han, Song and others},
year={2026}
eprint={2604.06916},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2604.06916},
}
@misc{zhu2026sanawm,
title={SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer},
author={Haoyi Zhu and Haozhe Liu and Yuyang Zhao and Tian Ye and Junsong Chen and Jincheng Yu and Tong He and Song Han and Enze Xie},
year={2026},
eprint={2605.15178},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2605.15178},
}
@misc{zhao2026sanastreamingrealtimestreamingvideo,
title={SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformer},
author={Yuyang Zhao and Yicheng Pan and Qiyuan He and Jincheng Yu and Junsong Chen and Tian Ye and Haozhe Liu and Enze Xie and Song Han},
year={2026},
eprint={2605.30409},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2605.30409},
}