Video as the New Language for Real-World Decision Making
Paper
•
2402.17139
•
Published
•
18
video
-
-
Learning and Leveraging World Models in Visual Representation Learning
Paper • 2403.00504 • Published • 31
MovieLLM: Enhancing Long Video Understanding with AI-Generated Movies
Paper • 2403.01422 • Published • 26-
VideoElevator: Elevating Video Generation Quality with Versatile Text-to-Image Diffusion Models
Paper • 2403.05438 • Published • 18 -
V3D: Video Diffusion Models are Effective 3D Generators
Paper • 2403.06738 • Published • 28 -
VideoMamba: State Space Model for Efficient Video Understanding
Paper • 2403.06977 • Published • 27 -
Follow-Your-Click: Open-domain Regional Image Animation via Short Prompts
Paper • 2403.08268 • Published • 15 -
Video Editing via Factorized Diffusion Distillation
Paper • 2403.09334 • Published • 21 -
Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding
Paper • 2403.09626 • Published • 13
FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation
Paper • 2403.12962 • Published • 7Note 换脸方案
-
GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creation
Paper • 2403.12365 • Published • 10 -
Mora: Enabling Generalist Video Generation via A Multi-Agent Framework
Paper • 2403.13248 • Published • 78 -
Efficient Video Diffusion Models via Content-Frame Motion-Latent Decomposition
Paper • 2403.14148 • Published • 18 -
StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text
Paper • 2403.14773 • Published • 10 -
InternVideo2: Scaling Video Foundation Models for Multimodal Video Understanding
Paper • 2403.15377 • Published • 22 -
TRIP: Temporal Residual Learning with Image Noise Prior for Image-to-Video Diffusion Models
Paper • 2403.17005 • Published • 13 -
LITA: Language Instructed Temporal-Localization Assistant
Paper • 2403.19046 • Published • 18 -
Streaming Dense Video Captioning
Paper • 2404.01297 • Published • 11 -
MagicTime: Time-lapse Video Generation Models as Metamorphic Simulators
Paper • 2404.05014 • Published • 32 -
MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding
Paper • 2404.05726 • Published • 20 -
PhysAvatar: Learning the Physics of Dressed 3D Avatars from Visual Observations
Paper • 2404.04421 • Published • 16 -
Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Model
Paper • 2404.09967 • Published • 20 -
PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioning
Paper • 2404.16994 • Published • 35 -
MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Model
Paper • 2404.19759 • Published • 24
VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models
Paper • 2403.06098 • Published • 15Note prompt-video dataset
-
iVideoGPT: Interactive VideoGPTs are Scalable World Models
Paper • 2405.15223 • Published • 12 -
MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model
Paper • 2405.20222 • Published • 10 -
I4VGen: Image as Stepping Stone for Text-to-Video Generation
Paper • 2406.02230 • Published • 16 -
SF-V: Single Forward Video Generation Model
Paper • 2406.04324 • Published • 23 -
Vript: A Video Is Worth Thousands of Words
Paper • 2406.06040 • Published • 25 -
MotionClone: Training-Free Motion Cloning for Controllable Video Generation
Paper • 2406.05338 • Published • 39 -
NaRCan: Natural Refined Canonical Image with Integration of Diffusion Prior for Video Editing
Paper • 2406.06523 • Published • 50 -
VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs
Paper • 2406.07476 • Published • 32 -
Hierarchical Patch Diffusion Models for High-Resolution Video Generation
Paper • 2406.07792 • Published • 13 -
AV-DiT: Efficient Audio-Visual Diffusion Transformer for Joint Audio and Video Generation
Paper • 2406.07686 • Published • 14 -
Training-free Camera Control for Video Generation
Paper • 2406.10126 • Published • 12 -
Vivid-ZOO: Multi-View Video Generation with Diffusion Model
Paper • 2406.08659 • Published • 8 -
VoCo-LLaMA: Towards Vision Compression with Large Language Models
Paper • 2406.12275 • Published • 29 -
Long Context Transfer from Language to Vision
Paper • 2406.16852 • Published • 32 -
Video-Infinity: Distributed Long Video Generation
Paper • 2406.16260 • Published • 28 -
DiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration Models
Paper • 2407.01519 • Published • 22 -
Consistency Flow Matching: Defining Straight Flows with Velocity Consistency
Paper • 2407.02398 • Published • 14 -
Compositional Video Generation as Flow Equalization
Paper • 2407.06182 • Published • 12 -
VIMI: Grounding Video Generation through Multi-modal Instruction
Paper • 2407.06304 • Published • 10 -
VEnhancer: Generative Space-Time Enhancement for Video Generation
Paper • 2407.07667 • Published • 14 -
SEED-Story: Multimodal Long Story Generation with Large Language Model
Paper • 2407.08683 • Published • 22 -
Live2Diff: Live Stream Translation via Uni-directional Attention in Video Diffusion Models
Paper • 2407.08701 • Published • 10 -
SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models
Paper • 2407.15841 • Published • 40 -
MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequence
Paper • 2407.16655 • Published • 30 -
FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attention
Paper • 2407.19918 • Published • 49 -
Tora: Trajectory-oriented Diffusion Transformer for Video Generation
Paper • 2407.21705 • Published • 27 -
UniTalker: Scaling up Audio-Driven 3D Facial Animation through A Unified Model
Paper • 2408.00762 • Published • 9