Field notes

Rob Burke

Latest side quest: Nov 2026

AI agents, side quests, and 25 years of synthetic characters

The remastered island from the Menagerie: a stone castle with an Irish flag, a slate-roofed shed, a timber stand and a pen of sheep under a misty sky

Side Quests · Nov 2026 · No. 24

The Remaster Benchmark

I had the AI model Fable 5.2 remaster the Synthetic Characters reunion site to learn how it sees and creates in 3D. I’ve found it useful to have personalized benchmarks that help develop my own intuition for working with new models in partially specified domains.

The Cast of Characters.

I accidentally created my own personal pelican on a bicycle. In October I brought back the cast of the MIT Media Lab’s Synthetic Characters group, 1996-2003 vintage, as a playable site (Old Dogs, Newer Tricks). Last week I pointed Anthropic’s new AI model, Fable 5.2, at that codebase and invited it to take ownership of the code (as encouraged by Anthropic’s prompting guide) and remaster the visuals.

Why a personal benchmark

I adore Simon Willison’s “pelican riding a bicycle” and Ethan Mollick’s “otter on a plane using Wifi”. Simon once illustrated six months of model progress entirely in pelicans.

What those visualizations don’t give me is intuition for what it’s like to work with the model myself. A personal benchmark refines your intuition for how a model performs on tasks you care about. For me that includes questions like “how strong is this model’s understanding of light in a scene” and “does this model have a sense of timing?”

Remaster, not ‘faithful recreation’

The key word is “remaster.” I invited the model to interpret and modernize, working from stills and video footage from the 1996-2003 era, rather than bake the most faithful recreation it could muster. The outcome should immediately feel familiar, but leave room for enhancements.

Think of the Legend of Zelda remaster, or my son’s Studio Series Transformers: the goal is an artifact that reflects how it looks in my imagination, filtered warmly through time, rather than an exact of how the original object looked. That makes the outcome (even more) subjective, and an invitation for future models to apply their own styles.

This is the result of one model (Fable 5.2 at Medium effort), working one weekend, and judged by me. It becomes a benchmark after the next model is asked to do the same. The whole protocol is three lines: (1) inputs – the groups’ original photos and films, (2) brief – you own the codebase, the design is also yours; remaster, don’t recreate, and (3) judge – me and my sons, available for iterative feedback over the weekend.

The Cast viewer at the top of this page is the unofficial scoreboard: 2000, October 2026 (Codex: GPT-6.1 Sol, GPT-6 Astra), November 2026 (Claude Fable 5.2). The next model that drops and is highly praised for its visual understanding gets the same originals, the same brief, and a new column. (Rabbit hole: there is a growing community around Topology AI.)

Lore drop (the fun stuff)

Six square texture tiles: castle wall, drystone wall, mill stone, roof slate, dressed stone and boulder
Six of the island’s surfaces, cut from my photographs of Ireland.

Over the weekend, the model kept asking me for backstory. Where are the characters from, and is Shep Scottish or Irish? (Irish.) If Irish, is this Connemara, or the Aran Islands, or what? (Probably off the coast in Co. Galway.) Is the thing he’s standing on made of materials he found around the island? (Absolutely.)

The material origin story questions sent me digging through Flickr to find old photos from my time living in Ireland, hunting for textures: stone walls, castle walls, slate, thatched roof.

Outcomes

The remaster is substantially better than the October original. It is nearly a Studio Series Transformer: almost, but not quite, as great as it looked in my imagination.

This isn’t meant to be a fair comparison; it’s informative. November started from October’s work, and the next model will start from November’s. It’s a way of gaining intuition, and, like the pelican and otter, showing progress.

I also asked Fable for its own account of how it did. It wrote one in its own voice, with pictures.

A small cafe with an open glass front: Shep works two buns on forks at a counter while three mannequin patrons on bar stools watch
(void*), 1999, as it stands in the Menagerie today. Updated lighting, character models, and, if you view the scene in the Menagerie, updated animations. I asked Fable to pick a remastered view it was proud of.

Next weekend I’m going into a photo editing task with a much clearer intuition for Fable’s understanding of photography, its sense of style, and its ability to interpret creative direction.

What do you need a “feel for” in the models you work with, and what (or who) is your pelican?

Check it out

  • The Cast viewer: every iteration beside its reference pictures.
  • The Menagerie: everyone together on the updated island.
  • Sheep herding: two levels completed, with Duncan’s model and animations much improved. The cutscenes between levels and the finale are entirely doable with this generation of model. I just need tokens enough and time.
  • Soul Characters: a Soul Calibur-esque game with our characters in it, in the improved arena.