Skip to content

[ARXIV'25] ReCamMaster: Camera-Controlled Generative Rendering from A Single Video

Notifications You must be signed in to change notification settings

KwaiVGI/ReCamMaster

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

17 Commits
 
 
 
 
 
 

Repository files navigation

ReCamMaster: Camera-Controlled Generative Rendering from A Single Video

Jianhong Bai1*, Menghan Xia2†, Xiao Fu3, Xintao Wang2, Lianrui Mu1, Jinwen Cao2,
Zuozhu Liu1, Haoji Hu1†, Xiang Bai4, Pengfei Wan2, Di Zhang2

(*Work done during an internship at KwaiVGI, Kuaishou Technology †corresponding authors)

1Zhejiang University, 2Kuaishou Technology, 3CUHK, 4HUST.

📖 Introduction

TL;DR: We propose ReCamMaster to re-capture in-the-wild videos with novel camera trajectories.

TEASER_compressed.mp4

🚀 Try ReCamMaster with Your Own Videos

Update: We are actively processing the videos uploaded by users. So far, we have sent the inference results to the email addresses of the first 70 testers. You should receive an email titled "Inference Results of ReCamMaster" from either [email protected] or [email protected].

You can try out our ReCamMaster by uploading your own video to this link, which will generate a video with camera movements along a new trajectory. We will send the mp4 file generated by ReCamMaster to your inbox as soon as possible. For camera movement trajectories, we offer 10 basic camera trajectories as follows:

Index Basic Trajectory
1 Pan Right
2 Pan Left
3 Tilt Up
4 Tilt Down
5 Zoom In
6 Zoom Out
7 Translate Up (with rotation)
8 Translate Down (with rotation)
9 Arc Left (with rotation)
10 Arc Right (with rotation)

If you would like to use ReCamMaster as a baseline and need qualitative or quantitative comparisons, please feel free to drop an email to [email protected]. We can assist you with batch inference of our model.

🤗 Awesome Related Works

Feel free to explore these outstanding related works, including but not limited to:

GCD: GCD synthesize large-angle novel viewpoints of 4D dynamic scenes from a monocular video.

ReCapture: a method for generating new videos with novel camera trajectories from a single user-provided video.

Trajectory Attention: Trajectory Attention facilitates various tasks like camera motion control on images and videos, and video editing.

GS-DiT: GS-DiT provides 4D video control for a single monocular video.

Diffusion as Shader: a versatile video generation control model for various tasks.

TrajectoryCrafter: TrajectoryCrafter achieves high-fidelity novel views generation from casually captured monocular video.

GEN3C: a generative video model with precise Camera Control and temporal 3D Consistency.

🌟 Citation

Please leave us a star 🌟 and cite our paper if you find our work helpful.

@misc{bai2025recammaster,
      title={ReCamMaster: Camera-Controlled Generative Rendering from A Single Video}, 
      author={Jianhong Bai and Menghan Xia and Xiao Fu and Xintao Wang and Lianrui Mu and Jinwen Cao and Zuozhu Liu and Haoji Hu and Xiang Bai and Pengfei Wan and Di Zhang},
      year={2025},
      eprint={2503.11647},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2503.11647}, 
}

About

[ARXIV'25] ReCamMaster: Camera-Controlled Generative Rendering from A Single Video

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published