Browse by type

Every piece organized by what it does for you.

Recipe1

Tools you can use today

How to Stop AI from Making Up Numbers

Most AI-generated numbers are unsourced. Three steps drop unsourced numbers to single digits. No prompt tricks. A workflow change. (Commensurable: 46% unsourced → 8% with source, same measurement construct.)

The Fabrication Problem

Experiment3

Data and results from testing

The Most Trustworthy AI Output Is the Least Reliable

2 min

The signals you use to judge AI output (citations, confidence, specificity) are the same signals fabrication produces. Sourced output acknowledges limits. Fabrication doesn't. The trust heuristic is backwards.

The Fabrication Problem

Why AI Can't Check Its Own Work

3 min

Built quality gates for AI agents. They passed their own checks. The output was wrong. The same process that made the error reviews the error.

The Fabrication Problem

Most AI Numbers Are Fabricated

8 min

Most AI-generated numbers are fabricated (77-100% temporally unstable). Better prompts reduce claim volume but don't fix fabrication rate. Source material does: drops unsourced numbers to single digits.

The Fabrication Problem

Arc1

Journey across multiple experiments

The Strongest Finding Was Wrong

3 min

The strongest measured effect in 87 experiments was three effects stacked as one. Caught by the same measurement tools that produced the original finding. The correction was more interesting than the original.

The "It Depends" Problem