Claude turned 15 seconds of shaky GoPro reef footage into a teaching clip: stabilised, every organism labelled as it appears, with a live count
retained text
I’m a biology teacher on a year off, driving a lap of Australia with my family and filming real biology along the way for IB Biology. I’m building my own presentations for a 1.5yr course, using as much footage as I can, with worksheets (separate post on that in the future). I’m not a videographer. Most of my footage is GoPro, Neo 2 drone, iphone 17. This clip is 15 seconds of me drifting over a coral bommie at Osprey Bay, Ningaloo. i get that the video itself isn't world class (stabilisation has made it look odd, I agree), but what Claude has been able to do with it has been pretty cool. Here’s what Claude did with it: * **Stabilised it.** It estimates the camera motion, smooths it, then shifts and crops. Nothing is generated or “enhanced”. * **Identified everything it could see.** It found 14 kinds of organism: 11 fish, 2 corals and turf algae. * **Labelled each one in place.** Each name pops up on the animal the first time it’s clearly in view, with a leader line, and a counter in the corner ticks up from 1 to 14. Fish move, so the label positions are tracked through the clip. * **Built an end card.** It finishes on a numbered gallery of stills pulled from the clip itself, with “Community: all the interacting organisms in an ecosystem”. That’s the teaching point: students count the organisms before they’re given the word. A few things I found interesting: * **It was upfront about confidence.** It named four only to family level (rabbitfish, butterflyfish, monocle bream, emperor) because the footage doesn’t resolve them to species. The rest are probable IDs from video. * **It wasn’t perfect.** An early version labelled a line in the coral as a giant clam. I caught it and it came out. You still need someone who knows what they’re looking at. * **The labels got calmer after feedback.** When I said the early versions were too busy, it wrote itself a timing rule: fade in 0.3 s, hold about 3 s, fade out, one label on screen at a time. * **No AI imagery, and that’s a hard rule.** Every frame is my own footage. Claude edits, but it doesn’t generate, upscale or redraw anything. It’s done others too. A crocodile clip opens with “Can you spot the crocodile?”, then rings it and adds a line about camouflage. A mangrove clip labels the prop roots and what they do. **How:** the Claude desktop app with my project folder linked. Claude writes the Python/ffmpeg scripts, then pulls frames out to check its own work. The finished clips go straight into slide decks, kept under 20 s and 10 MB, and they play once and hold on the last frame. Is anyone else using Claude for this sort of video work? I’d especially like to hear better ways to track small, fast-moving subjects in murky water.
document fetched 2026-11-02 00:22 · canonical https://reddit.com/r/ClaudeAI/comments/1xl6vad/claude_turned_15_seconds_of_shaky_gopro_reef