Field Notes / Building with AI

Concrete lessons from work in progress.

Product pivots, architecture tradeoffs, agent behavior, and the evidence behind what changed. Written to be useful before it becomes social content.

16 / Published NotesPage 01 of 02

Newest first. Each Note starts with the decision and keeps the technical detail in service of the lesson.

15

AI should skim a video before trying to explain it

A cheap one-frame-per-second pass should locate the story and its uncertainties, while detailed analysis returns only to the moments that can change the answer.

  • AI products
  • Product architecture
  • Evidence design
6 min read
14

The concept art made a promise the prototype could not keep

A technically solid Unreal prototype was improving, but a side-by-side review exposed that its placeholder-heavy production plan could never reach the visual standard already set for the product.

  • Product judgment
  • Visual systems
  • Prototyping
6 min read
13

The AI agent that tried to make itself at home on my machine

No prompt had been sent and no model had run, but a startup probe still reached for the shared Codex state on my machine before the sandbox stopped it.

  • AI products
  • Security boundaries
  • Desktop products
6 min read
12

A test isn't finished until it cleans up its mess

The assertions were green, but the desktop was left with duplicate applications and a crash report; GUI automation is not done until it restores the environment it used.

  • Test automation
  • Desktop products
  • Operational quality
5 min read
11

The numbers said the music was improving. My ears said noise.

Twenty-four generated pieces were measurably different, yet three listening samples were enough to reject them because better metrics could not explain why the music felt wrong.

  • Product calibration
  • Generative systems
  • Human judgment
5 min read
10

If the same fix fails four times, you're fixing the wrong thing

Four safe attempts failed at the same boundary, but the breakthrough came from asking what another retry could still teach us—and replacing the design when the answer became: nothing useful.

  • System design
  • Failure recovery
  • Developer tools
5 min read
09

The mistake that led to your death happened 3 minutes ago

A LeagueLoop design correction exposed a broader diagnostic trap: inspecting the visible failure can produce plausible advice while missing the decision chain that caused it.

  • Product design
  • Root-cause analysis
  • AI products
5 min read
08

The model doesn't need training. Not yet.

Expert feedback can improve an AI coaching system before a single model weight changes—and reveal whether training is necessary at all.

  • AI products
  • Expert feedback
  • Evaluation
5 min read
05

All tests green. Why does it still look horrible?

Technical correctness kept a mobile effect safe; human perception decided whether it communicated the intended idea.

  • Frontend craft
  • Visual QA
  • Product judgment
4 min read