rea-video

Reverse-engineer any video.

Shot by shot: was it filmed, AI-generated or coded, and how to remake it.

Website | 中文 | English | Русский | 日本語 | 한국어 | Español | Português | Français | Deutsch

⭐ Help more people find rea-video. Star this repo!

Left: a TikTok ad shot on a phone. Right: an AI remake with another product. rea-video's verdict: the left is all live footage, one set and two camera positions; the right is all AI, 8 shots across 3 generations.

Quick start

rea-video is built for AI agents. In Claude Code, Codex or any agent that can run commands, say:

Install https://github.com/JuneYaooo/rea-video, then break down this video: /path/to/video.mp4

The agent installs the CLI, learns the workflow and runs the whole thing. You need ffmpeg and Python 3.10+.

brew install ffmpeg            # or: sudo apt install ffmpeg
git clone https://github.com/JuneYaooo/rea-video && cd rea-video
bash scripts/install_skill.sh  # installs the CLI (pip, or pipx / a local .venv if pip is blocked) and links the skill into ~/.claude, ~/.codex, ~/.agents
rea-video --help

You get:

• a one-line summary, e.g. "41% AI video + 59% code UI, 8 s of real screen recording, library music at 122 BPM"
• a remake plan, split into what to film, what to generate and what to code
• a full report.html with per-shot frames, evidence, prompts, camera and lighting notes, and the audio breakdown

You can also hook up a video-capable model (Gemini or Doubao both work) by giving the agent its endpoint and key. That makes the live/AI/3D calls more accurate and adds a reverse-engineered prompt for every shot. It works fine without one; if your agent can see images, it checks the uncertain shots itself.

Reports are written in whichever language you ask in (Chinese or English). The example reports below are in English.

What it can break down

Video type	Examples	What you get
Live footage	Talking-head, tabletop, handheld product demo, vlog, store visit	Setups and camera positions, framing, camera moves, lighting (12 setups with gear lists), color grade
AI video	Text/image-to-video, AI short drama, AI music video	Evidence, a reverse-engineered prompt per shot, how to batch into generations and which model to use
Avatar	A portrait driven by audio, lip-sync	Which shots are avatar shots, what portrait and audio you need
3D / animation	Blender / C4D explainers, product animation, 2D animation, stop-motion	Whether to generate with a video model or render from 3D code
Code / template	Kinetic type, UI demos, charts, slide-style cards	Text, layout and motion timing, ready to rebuild as a Remotion project
Screen recording	Software tutorials, web demos	Which parts are real material you'll need to record yourself
Mixed / edits	AI characters + code UI + real screen capture; live footage with AI edits	Each shot judged separately, then reassembled on the original timeline

Besides how the visuals were made, every breakdown also covers:

• Captions and styled text: start and end of each line (exports to SRT / ASS), plus color, outline and how the text comes in
• Stickers, emoji, picture-in-picture: where they sit and how long they stay
• Editing: where the cuts are, how fast, whether they hit the beat
• Audio: human or AI voice, AI or library music and its BPM, where each sound effect lands
• Material you'll need to supply yourself: screen recordings, screenshots, product photos

Examples

The sample videos in docs/cases/videos/ are re-compressed to keep the repo small, which strips the TikTok / Douyin platform tags. So if you run them yourself, you'll get different results from the reports below, especially without a vision model. To reproduce them, use the original downloads from the platform.

Remakes

After rea-video breaks a video down, the remake recipe in capsule-cinema generates a new version that keeps the original's camera, motion, pacing and transitions and swaps only the elements you pick. These were made with a self-hosted MiniMax H3, using the original shot as the motion reference and keyframes with the swapped elements (gpt-image-2) for the look. Below are three remakes OiiOii showed in its WeChat articles. We made two versions of each: one with the same swap as OiiOii, and one that also swaps the subject, setting and props. Each GIF plays four versions in sync: the original, OiiOii's remake, our remake and the element-swap version.

The HD comparison videos use the original audio. The originals and OiiOii versions come from the articles and are shown for comparison only.

Accuracy

Accuracy of the how-it-was-made call, weighted by shot duration:

	Tuning set (15)	Holdout (16)	Re-encoded WeChat videos (10)
Tools only (offline, free)	98.3%	99.6% / 98.9%	88.6%
+ vision model (Gemini)	—	99.6% / 99.8%	99.6%
+ agent visual review	—	99.6% / 99.8%	100%

The Holdout column shows two numbers: holdout (9 videos) and holdout2 (7 videos).

On original files, the tools alone are usually enough. Videos downloaded from platforms have been recompressed, which wipes out the noise evidence, so you need a visual check to get back above 99%.

Real-asset detection is 97–99%, and shot boundaries are all correct. Numbers and how to reproduce them: eval/RESULTS.md.

How it works

1. Split: cut the video into shots and split the audio into voice, music and effects.
2. Gather evidence: measure (frame cadence, sensor noise, whether the whole image moves as one flat plane, AIGC tags in the metadata), look (hands, text, physics) and listen (BPM, key, singing vs speech).
3. Decide: hard evidence like AIGC tags and frame cadence beats "looks like". Conflicts get flagged for the agent to check visually.
4. Plan the remake: batch shots according to what the target video model can actually do, such as max clip length, multi-shot support and how many reference images it takes.

Star History

FAQ

Hypit takes a reference video and makes a new one: the agent reads frame grids to understand the original, generates footage with the models it supports (Seedance, PixVerse, MiniMax, Wan and others), and renders captions and motion graphics in HTML.

It doesn't ask how the original was made. A live-action source goes through the same pipeline; it won't tell you how many cameras were used or how it was lit. What AI video it can match depends on the models it supports: no Kling or Veo, no dedicated avatar or 3D path, and no AI music (you bring your own). It's strongest on talking-head, podcast and interview videos that follow a script, and weaker on music-driven edits, product motion graphics and cinematic shorts.

rea-video doesn't render a video. It works out shot by shot whether something was filmed, AI-generated or built in code, then gives a shooting plan, prompts or a code approach for each. For a quick lookalike, Hypit is faster. To understand how the original was made and remake it cheaply, use rea-video. They work fine together.

No. Tools-only mode is offline and free, and already accurate on original files. For recompressed platform downloads, add a video-capable model (Gemini or Doubao both work) or use an agent that can see images; you pay whatever that service charges. Automatic video generation (capsule-cinema) does a free dry run first and only calls paid models after you confirm.

Partly. With capsule-cinema installed, AI shots are generated and placed back on the original timeline automatically. You film the live shots from the shooting plan, and the agent writes the code shots as a Remotion project. See docs/replicate.md.

No. rea-video is for learning a video's structure, pacing and techniques, then remaking it with material you have the rights to. Don't reuse other people's footage, music, characters or likeness. Follow platform rules and local AI-content labeling requirements when you publish.

Docs

• docs/what-it-detects.md: everything it detects (10 visual types, camera, lighting, grade, audio)
• docs/replicate.md: how to remake from the report
• docs/cases.md: details on each example
• docs/decompose.md: detection rules
• docs/cli.md: CLI usage and capsule-cinema integration
• rea_video/capabilities/: capability tables for video / image / audio models, used to pick models for the remake plan
• eval/RESULTS.md: eval results

The docs are in Chinese for now.

Community

Questions, breakdowns and remake ideas: GitHub Discussions. Chat with us on Discord. Chinese speakers can also find us on linux.do.

Want a video broken down? Open a request issue with the link and we'll publish the result as a case.

Credits

Inspired by REA (Reverse Engineer Anything): work back from what you see to how it was made, back every claim with evidence, and verify by measuring.