AI Model Reviewer

Claude Fable 5.1

Anthropic. Run in Claude Code, OpenCode, Raw API call.

181 runs on 143 prompts · 89% finished

Results

The best run of each of its 143 tests first, then every other run. Filter them in the explorer

161 finished runs

Numbers: finish rate, cost, wall time, draft scores
Runs
181
on 143 prompts
Finished
89%
161 of 181
Median cost, finished run
$0.97
n=161
Median wall time, finished run
4m 02s
n=161
Recorded spend
$1,001.68
$186.75 on unfinished runs; 1 without a recorded cost

From the numbers

Set against the other models with at least 3 runs (top or bottom third), and its draft-score ranks within single prompts. Nothing here is averaged across prompts.

Strengths

  • Draft score 9.5/10 on Pelican riding a bicycle (control) (in OpenCode): ranked 1st of 13
  • Draft score 9/10 on Lighthouse on a headland at night (in OpenCode): ranked 1st of 12
  • Draft score 10/10 on Isometric SVG town with sprite sheet (in OpenCode): ranked 1st of 11
  • Draft score 9/10 on MacBook Pro 16" realistic 3D render (Playcode benchmark) (in Claude Code): ranked 2nd of 12
  • Draft score 9/10 on MacBook Pro 16" realistic 3D render (Playcode benchmark) (in OpenCode): ranked 2nd of 12
  • Draft score 8.5/10 on Lighthouse on a headland at night (in Claude Code): ranked 2nd of 12
  • Draft score 9.5/10 on Animated pelican riding a bicycle (SMIL/CSS) (in OpenCode): ranked 2nd of 12
  • Draft score 9.5/10 on Isometric SVG town with sprite sheet (in Claude Code): ranked 2nd of 11

Weaknesses

  • 3 runs ended as the model's own failure (DNF, class MODEL)
  • Other unfinished runs, not counted against the model: 1 HARNESS, 1 INFRA, 15 TIMEOUT

Best and hardest run

Best run

Picked as its best draft-score rank on a prompt.

Hardest run

Picked as its costliest run that did not finish.

Draft scores by prompt

Isometric SVG town with sprite sheetOpenCode10/10 draft1st of 11
Isometric SVG town with sprite sheetClaude Code9.5/10 draft2nd of 11
Lighthouse on a headland at nightOpenCode9/10 draft1st of 12
Lighthouse on a headland at nightClaude Code8.5/10 draft2nd of 12
MacBook Pro 16" realistic 3D render (Playcode benchmark)Claude Code9/10 draft2nd of 12
MacBook Pro 16" realistic 3D render (Playcode benchmark)OpenCode9/10 draft2nd of 12
Pelican riding a bicycle (control)OpenCode9.5/10 draft1st of 13
Pelican riding a bicycle (control)Claude Code8.5/10 draft9th of 13
Animated pelican riding a bicycle (SMIL/CSS)OpenCode9.5/10 draft2nd of 12
Animated pelican riding a bicycle (SMIL/CSS)Claude Code9/10 draft6th of 12

By harness

Raw API call11110897%$0.72 n=1082m 53s n=108
OpenCode302377%$8.67 n=2328m 33s n=23
Claude Code403075%$10.36 n=3032m 25s n=30
All 143 tests and experiment collections

Experiment collections: HTML Files (60) · SVG (110) · Three.js (37) · Harness lane (181)