← sources

Opus 5.5 animated this music video frame by frame: 4,320 frames, every jump locked to the beat

source: reddit (reddit:ClaudeAI)published 2026-10-23 19:22ingested 2026-10-24 02:36

retained text

No video editor, no animator. Suno made the song. Opus 5.5 wrote a 22,000-line Python engine in about a week, and that engine placed every single frame.

How it works:

* **First it takes the song apart.** AI stem splitting pulls out vocals, drums and bass. A beat tracker maps all 175 BPM, and forced alignment timestamps every one of the 337 sung words. The whole film runs on that clock.
* **The choreography is code, not keyframes.** Every move is pinned to an exact moment: “take off on bar 42”, “land on the snare at 58.37 s”. A physics solver with real gravity and stride lengths fills in the runs and jumps between those points.
* **The runner is 1,933 hand-picked drawings.** Wan image-to-video clips of him painted on a white wall get sliced into single poses. The engine picks one, holds it for a 16th note (about 2 frames), then swaps to the next. That’s where the stop-motion feel comes from.
* **Video models can’t keep a beat.** I tested Seedance with the actual song as input: it landed 1.25 to 2 seconds late every time, and the full film would have cost about $480. The code-timed version hit every beat exactly, for $0.30 on the same test clip.
* **One continuous shot, zero cuts.** Spring camera, dripping wet paint, rain, and at 0:57 he leaps in total silence and lands right on the drop.

Total AI generation cost for the whole film: about $187. 12 full renders before this one.

document fetched 2026-10-24 10:25 · canonical https://reddit.com/r/ClaudeAI/comments/1xdnfqe/opus_55_animated_this_music_video_frame_by_frame