该仓库是论文清单而非可运行代码,没有安装步骤;部分论文链接指向 arXiv 预印本,正式发表版本可能尚未更新;待办清单显示 NeurIPS 2025、ICCV 2025 论文尚未收录
awesome-video-generation
AlonzoLeeeoooMIT活跃维护汇总视频生成领域的论文与资源清单,覆盖扩散模型、GAN、文本生成视频等方向,方便快速追踪研究进展。
A collection of awesome video generation studies.
视频生成领域论文与资源汇总清单,按任务和年份分类,方便快速查找相关工作
汇总视频生成领域的论文与资源清单,覆盖扩散模型、GAN、文本生成视频等方向,方便快速追踪研究进展。
核心能力
- 按文生视频、图生视频、视频编辑等子任务分目录整理
- 按年份归档论文并附 arXiv、OpenReview 等原文链接
- 收录 Sora、Lumiere 等产品与机构信息表
- 维护 CVPR、NeurIPS 等会议论文更新进度清单
- 汇总数据集与综述论文入口
容易踩的坑
暂无 release 数据(可能没有发版,或尚未同步)。
用户点评
登录用户的真实使用记录,可按版本和硬件筛选还没有人点评。第一个说出真实体验的人最有价值。
This GitHub repository summarizes papers and resources related to the video generation task.
If you have any suggestions about this repository, please feel free to start a new issue or pull requests.
Recent news of this GitHub repo are listed as follows.
🔥 [Dec. 11th, 2025] Our paper titled "StableV2V: Stablizing Shape Consistency in Video-to-Video Editing" is accepted at TCSVT 2025!
🔥 [Nov. 19th] We have released our latest paper titled "StableV2V: Stablizing Shape Consistency in Video-to-Video Editing", with the correponding code, model weights, and a testing benchmark DAVIS-Edit open-sourced. Feel free to check them out from the links!
- [2025 May 13th] Update a new sub-task named Human Image Animation. All CVPR 2025 papers and references are updated.
- [Jun. 17th] All NeurIPS 2023 papers and references are updated.
- [Apr. 26th] Update a new direction: Personalized Video Generation.
- [Mar. 28th] The official AAAI 2024 paper list are released! Official version of PDFs and BibTeX references are updated accordingly.
Contents
- To-Do Lists
- Products
- Papers
- Datasets
- Q&A
- References
- Star History
- WeChat Group
To-Do Lists
- Latest Papers
- Update NeurIPS 2025 Papers
- Update ICCV 2025 Papers
- Update CVPR 2025 Papers
- Update ICLR 2025 Papers
- Update NeurIPS 2024 Papers
- Update ECCV 2024 Papers
- Update CVPR 2024 Papers
- Update PDFs and References of ⚠️ Papers
- Update Published Versions of References
- Update AAAI 2024 Papers
- Update PDFs and References of ⚠️ Papers
- Update Published Versions of References
- Update ICLR 2024 Papers
- Update NeurIPS 2023 Papers
- Previously Published Papers
- Update Previous CVPR papers
- Update Previous ICCV papers
- Update Previous ECCV papers
- Update Previous NeurIPS papers
- Update Previous ICLR papers
- Update Previous AAAI papers
- Update Previous ACM MM papers
- Regular Maintenance of Preprint arXiv Papers and Missed Papers
Products
| Name | Organization | Year | Research Paper | Website | Specialties |
|---|---|---|---|---|---|
| Sora | OpenAI | 2024 | link | link | - |
| Lumiere | 2024 | link | link | - | |
| VideoPoet | 2023 | - | link | - | |
| W.A.I.T | 2023 | link | link | - | |
| Gen-2 | Runaway | 2023 | - | link | - |
| Gen-1 | Runaway | 2023 | - | link | - |
| Animate Anyone | Alibaba | 2023 | link | link | - |
| Outfit Anyone | Alibaba | 2023 | - | link | - |
| Stable Video | StabilityAI | 2023 | link | link | - |
| Pixeling | HiDream.ai | 2023 | - | link | - |
| DomoAI | DomoAI | 2023 | - | link | - |
| Emu | Meta | 2023 | link | link | - |
| Genmo | Genmo | 2023 | - | link | - |
| NeverEnds | NeverEnds | 2023 | - | link | - |
| Moonvalley | Moonvalley | 2023 | - | link | - |
| Morph Studio | Morph | 2023 | - | link | - |
| Pika | Pika | 2023 | - | link | - |
| PixelDance | ByteDance | 2023 | link | link | - |
| Podframes | Jellypod | 2026 | - | link | Open-source topic-to-podcast video pipeline with mixed TTS voices, lip-synced avatars, captions, and b-roll. |
Papers
Survey Papers
- Year 2024
- arXiv
- Video Diffusion Models: A Survey [Paper]
- arXiv
- Year 2023
- arXiv
- A Survey on Video Diffusion Models [Paper]
- arXiv
Text-to-Video Generation
- Year 2026
- ICLR
- Astraea: A Token-wise Acceleration Framework for Video Diffusion Transformers [Paper]
- BLADE: Block-Sparse Attention Meets Step Distillation for Efficient Video Generation [Paper]
- BWCache: Accelerating Video Diffusion Transformers through Block-Wise Caching [Paper]
- CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Models [Paper]
- DSA: Efficient Inference For Video Generation Models via Distributed Sparse Attention [Paper]
- Dual-IPO: Dual-Iterative Preference Optimization for Text-to-Video Generation [Paper]
- DVD-Quant: Data-free Video Diffusion Transformers Quantization [Paper]
- Fastcar: Cache Attentive Replay for Fast Auto-Regressive Video Generation on the Edge [Paper]
- Flow Caching for Autoregressive Video Generation [Paper]
- JavisDiT++: Unified Modeling and Optimization for Joint Audio-Video Generation [Paper]
- JavisDiT: Joint Audio-Video Diffusion Transformer with Hierarchical Spatio-Temporal Prior Synchronization [Paper]
- LongLive: Real-time Interactive Long Video Generation [Paper]
- Lumos-1: On Autoregressive Video Generation with Discrete Diffusion from a Unified Model Perspective [Paper]
- Many-for-Many: Unify the Training of Multiple Video and Image Generation and Manipulation Tasks [Paper]
- MoAlign: Motion-Centric Representation Alignment for Video Diffusion Models [Paper]
- Model Already Knows the Best Noise: Bayesian Active Noise Selection via Attention in Video Diffusion Model [Paper]
- MoGA: Mixture-of-Groups Attention for End-to-End Long Video Generation [Paper]
- Neodragon: Mobile Video Generation Using Diffusion Transformer [Paper]
- NewtonGen: Physics-consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamics [Paper]
- PreciseCache: Precise Feature Caching for Efficient and High-fidelity Video Generation [Paper]
- QuantSparse: Comprehensively Compressing Video Diffusion Transformer with Model Quantization and Attention Sparsification [Paper]
- QVGen: Pushing the Limit of Quantized Video Generative Models [Paper]
- Rolling Forcing: Autoregressive Long Video Diffusion in Real Time [Paper]
- SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformer [Paper]
- Self-Forcing++: Towards Minute-Scale High-Quality Video Generation [Paper]
- SteinsGate: Adding Causality to Diffusions for Long Video Generation via Path Integral [Paper]
- Streaming Autoregressive Video Generation via Diagonal Distillation [Paper]
- Towards One-step Causal Video Generation via Adversarial Self-Distillation [Paper]
- TPDiff: Temporal Pyramid Video Diffusion Model [Paper]
- TS-Attn: Temporal-wise Separable Attention for Multi-Event Video Generation [Paper]
- TTOM: Test-Time Optimization and Memorization for Compositional Video Generation [Paper]
- UltraViCo: Breaking Extrapolation Limits in Video Diffusion Transformers [Paper]
- Uniform Discrete Diffusion with Metric Path for Video Generation [Paper]
- Video-GPT via Next Clip Diffusion [Paper]
- VMoBA: Mixture-of-Block Attention for Video Diffusion Models [Paper]
- Captain Cinema: Towards Short Movie Generation [Paper]
- FilMaster: Bridging Cinematic Principles and Generative AI for Automated Film Generation [Paper]
- EchoMotion: Unified Human Video and Motion Generation via Dual-Modality Diffusion Transformer [Paper]
- Video Unlearning via Low-Rank Refusal Vector [Paper]
- ScalingCache: Extreme Acceleration of DiTs through Difference Scaling and Dynamic Interval Caching [Paper]
- Plug-and-Play Fidelity Optimization for Diffusion Transformer Acceleration via Cumulative Error Minimization [Paper]
- DiCache: Let Diffusion Model Determine Its Own Cache [Paper]
- FlowCast: Trajectory Forecasting for Scalable Zero-Cost Speculative Flow Matching [Paper]
- HiCache: A Plug-in Scaled-Hermite Upgrade for Taylor-Style Cache-then-Forecast Diffusion Acceleration [Paper]
- Scale-wise Distillation of Diffusion Models [Paper]
- DiffSparse: Accelerating Diffusion Transformers with Learned Token Sparsity [Paper]
- ERTACache: Error Rectification and Timesteps Adjustment for Efficient Diffusion [Paper]
- MeanCache: From Instantaneous to Average Velocity for Accelerating Flow Matching Inference [Paper]
- Stochastic Self-Guidance for Training-Free Enhancement of Diffusion Models [Paper]
- Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistency [Paper]
- Consistent Noisy Latent Rewards for Trajectory Preference Optimization in Diffusion Models [Paper]
- FastFlow: Accelerating The Generative Flow Matching Models with Bandit Inference [Paper]
- SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention [Paper]
- EgoTwin: Dreaming Body and View in First Person [Paper]
- Let Features Decide Their Own Solvers: Hybrid Feature Caching for Diffusion Transformers [Paper]
- AAAI
- Minute-Long Videos with Dual Parallelisms [Paper] [Project] [Code]
- Sortblock: Similarity-Aware Feature Reuse for Diffusion Model [Paper]
- Sparse-vDiT: Unleashing the Power of Sparse Attention to Accelerate Video Diffusion Transformers [Paper]
- UltraGen: High-Resolution Video Generation with Hierarchical Attention [Paper]
- GENMAC: Compositional Text-to-Video Generation with Multi-Agent Collaboration [Paper]
- FilmWeaver: Weaving Consistent Multi-Shot Videos with Cache-Guided Autoregressive Diffusion [Paper]
- SphereDiff: Tuning-free 360° Static and Dynamic Panorama Generation via Spherical Latent Representation [Paper]
- FreeMem: Enhancing Consistency in Long Video Generation via Tuning-Free Memory [Paper]
- SwiftVideo: A Unified Framework for Few-Step Video Generation Through Trajectory-Distribution Alignment [Paper]
- S²Flow: Towards Fast and Authentic Training-Free High-Resolution Video Generation [Paper]
- PipeDiT: Accelerating Diffusion Transformers in Video Generation with Task Pipelining and Model Decoupling [Paper]
- DreamRunner: Fine-Grained Compositional Story-to-Video Generation with Retrieval-Augmented Motion Adaptation [Paper]
- ImagerySearch: Adaptive Test-Time Search for Video Generation Beyond Semantic Dependency Constraints [Paper]
- OmniVDiff: Omni Controllable Video Diffusion for Generation and Understanding [Paper]
- FlashVideo: Flowing Fidelity to Detail for Efficient High-Resolution Video Generation [Paper]
- Forecast Then Calibrate: Feature Caching as ODE for Efficient Diffusion Transformers [Paper]
- Less Is More: Vision Representation Compression for Efficient Video Generation with Large Language Models [Paper]
- HiTVideo: Hierarchical Tokenizers for Enhancing Text-to-Video Generation with Autoregressive Large Language Models [Paper]
- ICLR
- Year 2025
- CVPR
- AIGV-Assessor: Benchmarking and Evaluating the Perceptual Quality of Text-to-Video Generation with LMM [Paper] [Code]
- RAPO: The Devil is in the Prompts: Retrieval-Augmented Prompt Optimization for Text-to-Video Generation [Paper] [Project] [Code]
- ByTheWay: Boost Your Text-to-Video Generation Model to Higher Quality in a Training-free Way [Paper] [Code]
- The Devil is in the Prompts: Retrieval-Augmented Prompt Optimization for Text-to-Video Generation [Paper] [Project] [Code]
- ConsistID: Identity-Preserving Text-to-Video Generation by Frequency Decomposition [Paper] [Code] [Project]
- EIDT-V: Exploiting Intersections in Diffusion Trajectories for Model-Agnostic, Zero-Shot, Training-Free Text-to-Video Generation [Paper] [Code] [Project]
- TransPixeler: Advancing Text-to-Video Generation with Transparency [Paper] [Project] [Code]
- PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generation [Paper] [Code]
- InstanceCap: Improving Text-to-Video Generation via Instance-aware Structured Caption [Paper] [Code]
- BlobGEN-Vid: Compositional Text-to-Video Generation with Blob Video Representations [Paper] [Project]
- LinGen: Towards High-Resolution Minute-Length Text-to-Video Generation with Linear Computational Complexity [Paper] [Project]
- ⚠️ Encapsulated Composition of Text-to-Image and Text-to-Video Models for High-Quality Video Synthesis
- DynamicScaler: Seamless and Scalable Video Generation for Panoramic Scenes [Paper] [Project] [Code]
- AKiRa: Augmentation Kit on Rays for Optical Video Generation [Paper]
- Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise [Paper]
- DriveScape: High-Resolution Driving Video Generation by Multi-View Feature Fusion [Paper]
- Towards Precise Scaling Laws for Video Diffusion Transformers [Paper]
- VideoDPO: Omni-Preference Alignment for Video Diffusion Generation [Paper] [Project] [Code]
- Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model [Paper]
- Mask^2DiT: Dual Mask-based Diffusion Transformer for Multi-Scene Long Video Generation [Paper] [Project] [Code]
- Long Video Diffusion Generation with Segmented Cross-Attention and Content-Rich Video Data Curation [Paper] [Project] [Code]
- LongDiff: Training-Free Long Video Generation in One Go [Paper]
- Goku: Flow Based Video Generative Foundation Models [Paper]
- IM-Zero: Instance-level Motion Controllable Video Generation in a Zero-shot Manner [Paper]
- VideoGuide: Improving Video Diffusion Models without Training Through a Teacher's Guide [Paper] [Project] [Code]
- AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers [Paper] [Project] [Code]
- Mimir: Improving Video Diffusion Models for Precise Text Understanding [Paper]
- Optical-Flow Guided Prompt Optimization for Coherent Video Generation [Paper] [Project] [Code]
- SnapGen-V: Generating a Five-Second Video within Five Seconds on a Mobile Device [Paper] [Project]
- ShotAdapter: Text-to-Multi-Shot Video Generation with Diffusion Models [Paper] [Project]
- STDD: Spatio-Temporal Dual Diffusion for Video Generation [Paper]
- From Slow Bidirectional to Fast Autoregressive Video Diffusion Models [Paper] [Project] [Code]
- TokenMotion: Decoupled Motion Control via Token Disentanglement for Human-centric Video Generation [Paper]
- FreePCA: Integrating Consistency Information across Long-short Frames in Training-free Long Video Generation via Principal Component Analysis [Paper] [Code]
- Mind the Time: Temporally-Controlled Multi-Event Video Generation [Paper] [Project]
- Tora: Trajectory-oriented Diffusion Transformer for Video Generation [Paper] [Code]
- One-Minute Video Generation with Test-Time Training [Paper] [Project] [Code]
- ICCV
- Unified Video Generation: Unified Video Generation via Next-Set Prediction in Continuous Domain [Paper]
- Adversarial Distribution Matching for Diffusion Distillation Towards Efficient Image and Video Synthesis [Paper]
- REDUCIO! Generating 1K Video within 16 Seconds using Extremely Compressed Motion Latents [Paper]
- MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Control [Paper]
- Decouple and Track: Benchmarking and Improving Video Diffusion Transformers For Motion Transfer [Paper]
- TokensGen: Harnessing Condensed Tokens for Long Video Generation [Paper]
- Prompt-A-Video: Prompt Your Video Diffusion Model via Preference-Aligned LLM [Paper]
- LiON-LoRA: Rethinking LoRA Fusion to Unify Controllable Spatial and Temporal Generation for Video Diffusion [Paper]
- DropletVideo: A Dataset and Approach to Explore Integral Spatio-Temporal Consistent Video Generation [Paper]
- The Best of Both Worlds: Integrating Language Models and Diffusion Models for Video Generation [Paper]
- Long Context Tuning for Video Generation [Paper]
- Dual-Expert Consistency Model for Efficient and High-Quality Video Generation [Paper]
- NoiseController: Towards Consistent Multi-view Video Generation via Noise Decomposition and Collaboration [Paper]
- InstaDrive: Instance-Aware Driving World Models for Realistic and Consistent Video Generation [Paper]
- EfficientMT: Efficient Temporal Adaptation for Motion Transfer in Text-to-Video Diffusion Models [Paper]
- DOLLAR: Few-Step Video Generation via Distillation and Latent Reward Optimization [Paper]
- GameFactory: Creating New Games with Generative Interactive Videos [Paper]
- DLFR-Gen: Diffusion-based Video Generation with Dynamic Latent Frame Rate [Paper]
- MatchDiffusion: Training-free Generation of Match-Cuts [Paper]
- QuantCache: Adaptive Importance-Guided Quantization with Hierarchical Latent and Layer Caching for Video Generation [Paper]
- Free-Form Motion Control: Controlling the 6D Poses of Camera and Objects in Video Generation [Paper]
- Causal-Entity Reflected Egocentric Traffic Accident Video Synthesis [Paper]
- FreeScale: Unleashing the Resolution of Diffusion Models via Tuning-Free Scale Fusion [Paper]
- VPO: Aligning Text-to-Video Generation Models with Prompt Optimization [Paper]
- Video-T1: Test-time Scaling for Video Generation [Paper]
- MotionShot: Adaptive Motion Transfer across Arbitrary Objects for Text-to-Video Generation [Paper]
- STIV: Scalable Text and Image Conditioned Video Generation [Paper]
- Generating, Fast and Slow: Scalable Parallel Video Generation with Video Interface Networks [Paper]
- V.I.P.: Iterative Online Preference Distillation for Efficient Video Diffusion Models [Paper]
- Synthetic Video Enhances Physical Fidelity in Video Synthesis [Paper]
- Latent-Reframe: Enabling Camera Control for Video Diffusion Models without Training [Paper]
- FullDiT: Video Generative Foundation Models with Multimodal Control via Full Attention [Paper]
- VideoAuteur: Towards Long Narrative Video Generation [Paper]
- Model Reveals What to Cache: Profiling-Based Feature Reuse for Video Diffusion Models [Paper]
- Turbo2K: Towards Ultra-Efficient and High-Quality 2K Video Synthesis [Paper]
- Adaptive Caching for Faster Video Generation with Diffusion Transformers [Paper]
- Free2Guide: Training-Free Text-to-Video Alignment using Image LVLM [Paper]
- Progressive Growing of Video Tokenizers for Temporally Compact Latent Spaces [Paper]
- From Prompt to Progression: Taming Video Diffusion Models for Seamless Attribute Transition [Paper]
- Importance-Based Token Merging for Efficient Image and Video Generation [Paper]
- TITAN-Guide: Taming Inference-Time Alignment for Guided Text-to-Video Diffusion Models [Paper]
- Training-free and Adaptive Sparse Attention for Efficient Long Video Generation [Paper]
- UniMLVG: Unified Framework for Multi-view Long Video Generation with Comprehensive Control Capabilities for Autonomous Driving [Paper]
- CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Models [Paper]
- NeurIPS
- Stable Cinemetrics: Structured Taxonomy and Evaluation for Professional Video Generation [Paper] [Project]
- WISA: World simulator assistant for physics-aware text-to-video generation [Paper]
- VORTA: Efficient Video Diffusion via Routing Sparse Attention [Paper] [Code]
- ViewPoint: Panoramic Video Generation with Pretrained Diffusion Models [Paper]
- Inference-Time Text-to-Video Alignment with Diffusion Latent Beam Search [Paper]
- Radial Attention: $\mathcal{O}(n\log n)$ Sparse Attention with Energy Decay for Long Video Generation [Paper] [Code]
- Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Models [Paper]
- MagCache: Fast Video Generation with Magnitude-Aware Cache [Paper]
- $\text{S}^2$Q-VDiT: Accurate Quantized Video Diffusion Transformer with Salient Data and Sparse Token Distillation [Paper] [Code]
- WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perception [Paper]
- Show-o2: Improved Native Unified Multimodal Models [Paper] [Code]
- GeoVideo: Introducing Geometric Regularization into Video Generation Model [Paper]
- Re-ttention: Ultra Sparse Visual Generation via Attention Statistical Reshape [Paper]
- Genesis: Multimodal Driving Scene Generation with Spatio-Temporal and Cross-Modal Consistency [Paper]
- Training-Free Efficient Video Generation via Dynamic Token Carving [Paper]
- Improving Video Generation with Human Feedback [Paper]
- FlowMo: Variance-Based Flow Guidance for Coherent Motion in Video Generation [Paper]
- ASDSV: Multimodal Generation Made Efficient with Approximate Speculative Diffusion and Speculative Verification [Paper]
- Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutation [Paper] [Code]
- VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Models [Paper] [Project]
- PAROAttention: Pattern-Aware ReOrdering for Efficient Sparse and Quantized Attention in Visual Generation Models [Paper]
- LeMiCa: Lexicographic Minimax Path Caching for Efficient Diffusion-Based Video Generation [Paper]
- Hierarchical Fine-grained Preference Optimization for Physically Plausible Video Generation [Paper]
- Normalized Attention Guidance: Universal Negative Guidance for Diffusion Models [Paper]
- FPSAttention: Training-Aware FP8 and Sparsity Co-Design for Fast Video Diffusion [Paper]
- PanoWan: Lifting Diffusion Video Generation Models to 360$^\circ$ with Latitude/Longitude-aware Mechanisms [Paper]
- Faster Video Diffusion with Trainable Sparse Attention [Paper] [Code]
- VETA-DiT: Variance-Equalized and Temporally Adaptive Quantization for Efficient 4-bit Diffusion Transformers [Paper] [Code]
- Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion [Paper]
- Foresight: Adaptive Layer Reuse for Accelerated and High-Quality Text-to-Video Generation [Paper]
- InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generation [Paper]
- DenseDPO: Fine-Grained Temporal Preference Optimization for Video Diffusion Models [Paper]
- Rare Text Semantics Were Always There in Your Diffusion Transformer [Paper]
- ICLR
- OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generation [Paper] [Project] [Code] [Dataset]
- CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer [Paper]
- Pyramidal Flow Matching for Efficient Video Generative Modeling [Paper] [Project] [Code]
- ARLON: Boosting Diffusion Transformers with Autoregressive Models for Long Video Generation [Paper]
- VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control [Paper]
- Real-Time Video Generation with Pyramid Attention Broadcast [Paper]
- SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpoints [Paper]
- FreqPrior: Improving Video Diffusion Models with Frequency Filtering Gaussian Noise [Paper]
- FasterCache: Training-Free Video Diffusion Model Acceleration with High Quality [Paper]
- Lumina-T2X: Scalable Flow-based Large Diffusion Transformer for Flexible Resolution Generation [Paper]
- VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation [Paper]
- T2V-Turbo-v2: Enhancing Video Model Post-Training through Data, Reward, and Conditional Guidance Design [Paper]
- MotionAura: Generating High-Quality and Motion Consistent Videos using Discrete Diffusion [Paper]
- ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation [Paper]
- SAFREE: Training-Free and Adaptive Guard for Safe Text-to-Image And Video Generation [Paper]
- CameraCtrl: Enabling Camera Control for Video Diffusion Models [Paper]
- GameGen-X: Interactive Open-world Game Video Generation [Paper]
- IV-mixed Sampler: Leveraging Image Diffusion Models for Enhanced Video Synthesis [Paper]
- MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequences [Paper]
- Field-DiT: Diffusion Transformer on Unified Video, 3D, and Game Field Generation [Paper]
- Accelerating Diffusion Transformers with Token-wise Feature Caching [Paper]
- VSTAR: Generative Temporal Nursing for Longer Dynamic Video Synthesis [Paper]
- PT-T2I/V: An Efficient Proxy-Tokenized Diffusion Transformer for Text-to-Image/Video-Task [Paper]
- ICML
- VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Models [Paper]
- Q-VDiT: Towards Accurate Quantization and Distillation of Video-Generation Diffusion Transformers [Paper] [Code]
- Ca2-VDM: Efficient Autoregressive Video Diffusion Model with Causal Generation and Cache Sharing [Paper] [Code]
- Diffusion Adversarial Post-Training for One-Step Video Generation [Paper]
- AsymRnR: Video Diffusion Transformers Acceleration with Asymmetric Reduction and Restoration [Paper] [Code]
- Sparse Video-Gen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity [Paper] [Code]
- Fast Video Generation with Sliding Tile Attention [Paper] [Code]
- RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformers [Paper] [Code]
- AAAI
- Ouroboros-Diffusion: Exploring Consistent Content Generation in Tuning-free Long Video Diffusion [Paper]
- UFO: Enhancing Diffusion-Based Video Generation with a Uniform Frame Organizer [Paper]
- Modular-Cam: Modular Dynamic Camera-view Video Generation with LLM [Paper]
- AdaDiff: Adaptive Step Selection for Fast Diffusion Models [Paper]
- PanoDiT: Panoramic Videos Generation with Diffusion Transformer [Paper]
- VideoElevator: Elevating Video Generation Quality with Versatile Text-to-Image Diffusion Models [Paper]
- DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation [Paper]
- SIGGRAPH
- ACM MM
- arXiv
- Stable Video Infinity: Infinite-Length Video Generation with Error Recycling [Paper] [Project] [Code] [Video (YouTube)] [Video (Bilibili)]
- FEAT: Full-Dimensional Efficient Attention Transformer for Medical Video Generation [Paper] [Code]
- CVPR
- Year 2024
- CVPR
- Vlogger: Make Your Dream A Vlog [Paper] [Code]
- Make Pixels Dance: High-Dynamic Video Generation [Paper] [Project] [Demo]
- VGen: Hierarchical Spatio-temporal Decoupling for Text-to-Video Generation [Paper] [Code] [Project]
- GenTron: Delving Deep into Diffusion Transformers for Image and Video Generation [Paper] [Project]
- SimDA: Simple Diffusion Adapter for Efficient Video Generation [Paper] [Code] [Project]
- MicroCinema: A Divide-and-Conquer Approach for Text-to-Video Generation [Paper] [Project] [Video]
- Generative Rendering: Controllable 4D-Guided Video Generation with 2D Diffusion Models [Paper] [Project]
- PEEKABOO: Interactive Video Generation via Masked-Diffusion [Paper] [Code] [Project] [Demo]
- EvalCrafter: Benchmarking and Evaluating Large Video Generation Models [Paper] [Code] [Project]
- A Recipe for Scaling up Text-to-Video Generation with Text-free Videos [Paper] [Code] [Project]
- BIVDiff: A Training-free Framework for General-Purpose Video Synthesis via Bridging Image and Video Diffusion Models [Paper] [Project]
- Mind the Time: Scaled Spatiotemporal Transformers for Text-to-Video Synthesis [Paper] [Project]
- Animate Anyone: Consistent and Controllable Image-to-video Synthesis for Character Animation [Paper] [Code] [Project]
- MotionDirector: Motion Customization of Text-to-Video Diffusion Models [Paper] [Code]
- Hierarchical Patch-wise Diffusion Models for High-Resolution Video Generation [Paper] [Project]
- DiffPerformer: Iterative Learning of Consistent Latent Guidance for Diffusion-based Human Video Generation [Paper] [Code]
- Grid Diffusion Models for Text-to-Video Generation [Paper] [Code] [Video]
- ECCV
- Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioning [Paper] [Project]
- W.A.L.T.: Photorealistic Video Generation with Diffusion Models [Paper] [Project]
- MoVideo: Motion-Aware Video Generation with Diffusion Models [Paper]
- DrivingDiffusion: Layout-Guided Multi-View Driving Scenarios Video Generation with Latent Diffusion Model [Paper] [Code] [Project]
- MagDiff: Multi-Alignment Diffusion for High-Fidelity Video Generation and Editing [Paper]
- HARIVO: Harnessing Text-to-Image Models for Video Generation [Paper] [Project]
- MEVG: Multi-event Video Generation with Text-to-Video Models [Paper] [Project]
- NeurIPS
- ICML
- ICLR
- AAAI
- Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videos [Paper] [Code] [Project]
- E2HQV: High-Quality Video Generation from Event Camera via Theory-Inspired Model-Aided Deep Learning [Paper]
- ConditionVideo: Training-Free Condition-Guided Text-to-Video Generation [Paper] [Code] [Project]
- F3-Pruning: A Training-Free and Generalized Pruning Strategy towards Faster and Finer Text to-Video Synthesis [Paper]
- arXiv
- Lumiere: A Space-Time Diffusion Model for Video Generation [Paper] [Project]
- Boximator: Generating Rich and Controllable Motions for Video Synthesis [Paper] [Project] [Video]
- World Model on Million-Length Video And Language With RingAttention [Paper] [Code] [Project]
- Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motion [Paper] [Project]
- WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokens [Paper] [Code] [Project]
- MagicVideo-V2: Multi-Stage High-Aesthetic Video Generation [Paper] [Project]
- Latte: Latent Diffusion Transformer for Video Generation [Paper] [Code] [Project]
- Mora: Enabling Generalist Video Generation via A Multi-Agent Framework [Paper] [Code]
- StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text [Paper] [Code] [Project] [Video]
- VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Models [Paper]
- StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation [Paper] [Code] [Project] [Demo]
- Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Model [Paper] [Code] [Project]
- ControlNeXt: Powerful and Efficient Control for Image and Video Generation [Paper] [Code] [Project]
- FancyVideo: Towards Dynamic and Consistent Video Generation via Cross-frame Textual Guidance [Paper] [Project]
- Factorized-Dreamer: Training A High-Quality Video Generator with Limited and Low-Quality Data [Paper] [Code]
- Fine-gained Zero-shot Video Sampling [[Paper]](https://arxiv.org/pd
- CVPR