AI Model Reviewer

Pi 0.87.1

1 model ran in it: Claude Opus 5.5.

8 runs on 8 prompts · 88% finished

Results

The best run of each of its 8 tests first, then every other run. Filter them in the explorer

7 finished runs

Numbers: finish rate, cost, wall time, draft scores
Runs
8
on 8 prompts
Finished
88%
7 of 8
Median cost, finished run
$4.89
n=7
Median wall time, finished run
29m 04s
n=7
Recorded spend
$59.11
$7.01 on unfinished runs

From the numbers

Set against the other harnesses with at least 3 runs (top or bottom third), and its draft-score ranks within single prompts. Nothing here is averaged across prompts.

Strengths

  • 7 of 8 runs finished: 4th of 14 harnesses with at least 3 (finish rate)

Weaknesses

  • 29m 04s (n=7): 9th of 12 harnesses with at least 3 (median wall time of a finished run)
  • $4.89 (n=7): 10th of 12 harnesses with at least 3 (median cost of a finished run)
  • Other unfinished runs, not counted against the model: 1 TIMEOUT

Best and hardest run

Best run

Picked as its fastest finished run (no scored result yet).

Hardest run

Picked as its costliest run that did not finish.

Draft scores by prompt

No scored result yet (only prompts with a published rubric are scored).

By model

Claude Opus 5.58788%$4.89 n=729m 04s n=7
All 8 tests