Try it yourself
Side Quests have become my write-ups of building things with AI partners. The first, written up over the first weekend of January 2026, turned my son’s first CrunchLabs build-box experiment, Galton’s Goalie, into a live bell-curve visualization. A few hours with Claude delivered what would have taken me months in a research lab back in 2004. My mind was blown. The last CrunchLabs Season 2 box, Magnus Flyer, arrived last week, prompting this, the season finale.
Here’s the end result: seven literal curveballs, overlaid and visualized. An AI orchestrator, a builder, and critic made it happen, while me & the family provided the creative direction. There’s probably a metaphor in there somewhere. The rest of this side quest is links to the goodies we created while making this, and the story of how we got there in just over 24 hours.
A quick look back before we look forward: eight threads I see connecting this year’s side quests to this finale, visualized as frenkit intervals.
A Year of Engineering Hustle
Hover to look back. Open a quest to time travel.
Tap a lane to look back. Tap a thumbnail to time travel.
Computer vision2 quests
Old things, new builds5 quests
Legend of the Greasepole: Resurrected
10k lines migrated twice. 50 students built it, AI resurrected it.
LegendWeb: Resurrected
FrontPage 98 museum site of 60+ pages reborn and optimized.
Man, Machine, Drawer
A Kobo and a Garmin, hung off a USB and brought back from the dead.
Old Dogs, Newer Tricks
Twenty-five years later, Silas, Duncan, Goatzilla and the whole cast of characters reunite on the Isle of Man’s Best Friend.
The Magnus Effect
All this year needed was some LITERAL curveballs.
Tools of my own7 quests
Withings to Garmin Instant Sync
Health integration I use daily and my first AWS Lambda.
Side Quest Helper
WordPress automation, built on a plane at 10,000 ft.
Tax Return Assistant
Sparking today’s meditation on ‘what will happen to the professions’.
Obsidian All the Things
Markdown is the new lingua franca of my life.
SAASpocalypse Now
The hour I truly believed in the SAASpocalypse.
Man, Machine, Drawer
A Kobo and a Garmin, hung off a USB and brought back from the dead.
The Magnus Effect
All this year needed was some LITERAL curveballs.
Projects with (and for) the kids5 quests
Galton’s Goalie
Computer vision over Plinko math, inspired by Mark Rober’s CrunchLabs.
Minecraft Build Bot
L-systems, Lorenz attractors, and a G1 Ark (was how it started)
Full Ted Lasso (is the ROI)
My AI assistant does the lineup while I focus on the kids.
Old Dogs, Newer Tricks
Twenty-five years later, Silas, Duncan, Goatzilla and the whole cast of characters reunite on the Isle of Man’s Best Friend.
The Magnus Effect
All this year needed was some LITERAL curveballs.
Photography5 quests
Swim Meet Photographer’s Assistant
Claude plans the shoot, Dad held the camera.
Brand New Renaissance
Teaching an AI my taste: 2,500 frames in, 24 bangers out.
Vibe Photography
I share the memory; an AI takes the helm in Lightroom.
From Assistant to Partner
The season’s first swim meet, 2,814 photographs, and AI partners that took on the toil so I could stay the photographer.
The Magnus Effect
All this year needed was some LITERAL curveballs.
Cast of Characters5 quests
AI-Assisted Travel
18 days in Japan with an AI assistant in the family group chat, and a souvenir at the end.
frenkit, finally.
After a twenty-five year interval, my thesis is getting a body.
From Assistant to Partner
The season’s first swim meet, 2,814 photographs, and AI partners that took on the toil so I could stay the photographer.
Old Dogs, Newer Tricks
Twenty-five years later, Silas, Duncan, Goatzilla and the whole cast of characters reunite on the Isle of Man’s Best Friend.
The Magnus Effect
All this year needed was some LITERAL curveballs.
How we build5 quests
Anthropic Architect Cert
Anthropic says: certified. Tips inside.. they test judgment, not trivia.
Ad Astra
I stopped playing ‘courier’ between Claude and Codex, settling in for long-time partnership.
Bitter Lesson, 2026 Vintage
Mollick is right, the frontier doesn’t need my tracks. My daily drivers still need my scars.
Old Dogs, Newer Tricks
Twenty-five years later, Silas, Duncan, Goatzilla and the whole cast of characters reunite on the Isle of Man’s Best Friend.
The Magnus Effect
All this year needed was some LITERAL curveballs.
Writing and Sharing Ideas5 quests
Side Quest Helper
WordPress automation, built on a plane at 10,000 ft.
Obsidian All the Things
Markdown is the new lingua franca of my life.
AI-isms Defence
Japan made SPAM delicious (I hear). Can we do the same to AI slop?
AI-Assisted Travel
18 days in Japan with an AI assistant in the family group chat, and a souvenir at the end.
The Magnus Effect
All this year needed was some LITERAL curveballs.
Eight lanes tie into one finale. (Season finale, not series, I hope!)
I love finding episodic story arcs. Some of the best season finales call back to many of the previous episodes, so we’re going to do that – in an episode called…
The Magnus Flyer Full-Circle Moment
This week, the last box of CrunchLabs Season 2 arrived – the “Magnus Flyer”, with Mark Rober hooking young builders by asking how pitchers throw curveballs (baseball looms large in my house (see Full Ted Lasso)).
The Flyer is a foam tube that gets blasted from a launcher that gives it backspin. Launch it flat and it lifts; upside down, it dives; sideways, it curves. It’s called the Magnus effect.
While doing swim photography at scale (see From Assistant to Partner) I think a lot about working at “production speed“, so for this, I timeboxed the quest to 24 hours, and started by heading to Claude to jam.
Before: Shot plan
Thursday night: We assembled the “AI council” (see Ad Astra). Claude Opus 5.5 orchestrated, and partnered with Astra, my fav partner for visual taste (see Vibe Photography) and Codex Sol to build (like in Old Dogs, New Tricks). Solid crew.
Astra reviewed the shot plan twice, suggested “compose around the launch point and actual flight, then let the tree fill the remaining frame”, proposed a diagonal launch across the frame, rehearsing the orientations before recording, and checking a practice flight frame by frame.
We did a preflight with the camera, tested the settings, got ready for an unusually awesome walk to school in the morning.
During: morning walk-to-school film shoot
Friday: Woke up to rain. OK. “Planning meets serendipity” is the motto (AI Assisted Travel), so let’s make it work with flat lighting and reflections. On the walk to school, I set the D850 on the tripod and recorded in 4K at 30 frames a second. The histogram was piled against the left wall, and I corrected the exposure with some feedback thru Navy, my AI agent, in my ear, using the newly minted event mode (see frenkit, finally about Navy, and I’m excited to share more about event mode in the next Side Quest..).
The shoot went from fun, to wet, to chatting with friends also walking to school excited to talk about CrunchLabs, to downright soggy, finally to us running to school (almost) in time for the bell.
After: the build
I got home and handed the clips to Astra for review. Astra selected three flights and a base frame showing Ethan from behind, then wrote the brief for Sol, my builder in Codex. Sol reported back after about 21 minutes with a tracker, a three-trail composite and a silent five-second animation.
The next pass covered all seven flights and seven visual treatments, including real Flyer cutouts, accumulated red pixels and separate panels.
(A bit of detail, for the curious: Across seven flights, 74 positions came from automatic detections and 143 were manually corrected; 27 hidden frames stayed blank. These were separate launches with different release heights, stances and aim. We could not reliably identify each take’s launch orientation – which was fine – this was part of the learning.)
Astra proposed five bold trails and two quiet ones, with a pale core and glow. Indeed, Astra was all about the science: “Width and glow may amplify the evidence; they may not lengthen a path, close an unseen loop, erase release differences or paint light onto the street.”
Enter Julian, Baseball Fanatic
In my experience: Astra works best as a creative partner when you explain why you care (see Vibe Photography).
“Show how this illustrates the Magnus effect” wasn’t doing it, so I summoned Julian, my older son, who sends me cool baseball visualizations. He suggested Pitching Ninja’s overlay of Paul Skenes’ four pitches. The overlay gave us a common release time and one clear throw with other throws visible around it. Julian also brought in the growing-trail idea: a trail that never disappears, thin at the start and thicker behind the red Flyer, like in this pitch overlay.
So now we had a couple of references to steer by: Ethan’s kinetic energy, kid on way to school, Magnus effect visualized, reference material from YouTubers showcasing epic pitching technique. Oh, and public-image requirement for the younger kiddo: Ethan’s face stays out.
A few more rounds of feedback, using tactics from Old Dogs New Tricks, including Impact Font on that well-known dev tool, MS Paint:
And finally:
Even the ending went to a family vote: two versions with different end poses, side by side as an Artefact, and B won four to nothing.
And (echoing my observation from Galton’s Goalie) why have one colour palette when you can bake and choose between multiple contenders:
Smoothing
I learned some physics. I asked for parabolas, Claude and Astra corrected my understanding. With lift, drag and the camera angle in play, a parabola was asking too much.
As ever, timing was key. Julian suggested time-warping the shots to make it easier to absorb the curves, and not get distracted by timing. And we experimented with all 7 shots firing at once (Baseball Ninja style), versus a “pew pew pew” which ultimately we all thought worked better.
And I asked Astra to play the Perfection Game with me (score it out of ten, then tell me what would make it a ten), which is how we often work.
What I learned
- The earlier the better to summon a human who knows the subject matter and can provide visual and contextual references, as Julian did with baseball. That was some great prior art.
- A video-specific one: Privacy and cropping was a pain to get right, and it would have gone easier if we started with silhouette mattes, rather than going from head boxes to approved windows to silhouettes.
- Have a critic review the capture plan before recording, and inspect a practice video frame by frame. There were many hiccups and retries along the way we could have avoided with this.
- A few tactical ones about motion tracking: (1) Check detected centres against the source frames and correct mistakes before rendering. (2) Stop paths at the last observed centre. Two flights went out of the camera’s view with their landings unresolved in the tracking record.
Credits
Ethan built, launched, and inspired. Julian supplied the baseball smarts and references. Codex Astra reviewed the footage and wrote build briefs. Codex Sol built the tracker and renders. Claude Opus orchestrated and spot-checked. Navy in my ear corrected the histogram (driven by Sonnet – and don’t judge – my video intuition is next to nil). Mark Rober and the CrunchLabs crew made the box, the season, and encouraged all this engineering hustle.
Onwards to the next season.
P.S. I took my own advice almost immediately. I asked my son, who knows a lot more about YouTube Shorts than I do, what he’d do with this footage. How long should it be? What would he keep? A few hours later we had a 26-second engineering hustle video, CrunchLabs style. Check it out yourself.