Cline CLI
5 models ran in it: DeepSeek V4.1 Flash, Gemini 3.8 Flash, MiMo V2.6 Flash, Muse Spark 1.3, Space Bunny Alpha.
67 runs on 14 prompts · 52% finished
Results
The best run of each of its 14 tests first, then every other run. Filter them in the explorer
35 finished runs
Isometric SVG town with sprite sheet
MiMo V2.6 Flash
Cline CLI 3.0.65
skills off
Failed · Stopped by our timeout
Animated pelican riding a bicycle (SMIL/CSS)
MiMo V2.6 Flash
Cline CLI 3.0.65
skills off
Failed · Stopped by our timeout
Animated pelican riding a bicycle (SMIL/CSS)
DeepSeek V4.1 Flash
Cline CLI 3.0.65
skills off
Failed · Error
DualSense controller, max fidelity
Gemini 3.8 Flash
Cline CLI 3.0.65
skills off
Failed · Stopped by our timeout
MacBook Pro 16" realistic 3D render (Playcode benchmark)
DeepSeek V4.1 Flash
Cline CLI 3.0.65
skills off
Failed · Error
MacBook Pro 16" realistic 3D render (Playcode benchmark)
Gemini 3.8 Flash
Cline CLI 3.0.65
skills off
Failed · Did not finish
MacBook Pro 16" realistic 3D render (Playcode benchmark)
MiMo V2.6 Flash
Cline CLI 3.0.65
skills off
Failed · Error
MacBook Pro 16" realistic 3D render (Playcode benchmark)
Gemini 3.8 Flash
Cline CLI 3.0.65
skills off
Failed · Error
MacBook Pro 16" realistic 3D render (Playcode benchmark)
MiMo V2.6 Flash
Cline CLI 3.0.65
skills off
Failed · Error
Lighthouse on a headland at night
DeepSeek V4.1 Flash
Cline CLI 3.0.65
skills off
Failed · Stopped by us
California brown pelican riding a bicycle (detailed spec)
DeepSeek V4.1 Flash
Cline CLI 3.0.65
skills off
Failed · Error
California brown pelican riding a bicycle (detailed spec)
MiMo V2.6 Flash
Cline CLI 3.0.65
skills off
Failed · Error
BMW M4 Competition, side view (flat vector)
Gemini 3.8 Flash
Cline CLI 3.0.65
skills off
Failed · Did not finish
BMW M4 Competition, side view (flat vector)
Gemini 3.8 Flash
Cline CLI 3.0.65
skills off
Failed · Did not finish
Numbers: finish rate, cost, wall time, draft scores
- Runs
- 67
- on 14 prompts
- Finished
- 52%
- 35 of 67
- Median cost, finished run
- $0
- n=23
- Median wall time, finished run
- 5m 34s
- n=35
- Recorded spend
- $0
- $0 on unfinished runs; 42 without a recorded cost
From the numbers
Set against the other harnesses with at least 3 runs (top or bottom third), and its draft-score ranks within single prompts. Nothing here is averaged across prompts.
Strengths
- 5m 34s (n=35): 2nd of 12 harnesses with at least 3 (median wall time of a finished run)
- $0 (n=23): 1st of 12 harnesses with at least 3 (median cost of a finished run)
Weaknesses
- 35 of 67 runs finished: 12th of 14 harnesses with at least 3 (finish rate)
- 4 runs ended as the model's own failure (DNF, class MODEL)
- Other unfinished runs, not counted against the model: 9 HARNESS, 12 INFRA, 7 TIMEOUT
Best and hardest run
Best run
Picked as its fastest finished run (no scored result yet).
-
Space Bunny Alpha, Cline CLI, BMW M4 Competition, side view (flat vector)
Cline CLI 3.0.65, high effort
skills off
1m 04s
$0 reported by Cline CLI
OK
Unscored: no rubric for this prompt
Hardest run
Picked as its slowest finished run.
-
Muse Spark 1.3, Cline CLI, DualSense controller, max fidelity
Cline CLI 3.0.65, high effort
skills off
56m 12s
not recorded: the run's usage was never recorded
OK
Unscored: no rubric for this prompt
Draft scores by prompt
No scored result yet (only prompts with a published rubric are scored).
By model
| Muse Spark 1.3 | 12 | 12 | 100% | $0 n=7 | 4m 35s n=12 |
|---|---|---|---|---|---|
| Space Bunny Alpha | 11 | 11 | 100% | $0 n=11 | 2m 26s n=11 |
| Gemini 3.8 Flash | 15 | 8 | 53% | $0 n=3 | 9m 44s n=8 |
| DeepSeek V4.1 Flash | 13 | 2 | 15% | not recorded: no finished run with a recorded cost | 14m 35s n=2 |
| MiMo V2.6 Flash | 16 | 2 | 12% | $0 n=2 | 49m 26s n=2 |
All 14 tests
- Animated short (HTML/JS) (1 run)
- Pelican car france (4 runs)
- Whale clouds (5 runs)
- Isometric SVG town with sprite sheet (6 runs)
- Animated pelican riding a bicycle (SMIL/CSS) (6 runs)
- Dolphin vlog bicycle (5 runs)
- DualSense controller, max fidelity (6 runs)
- MacBook Pro 16" realistic 3D render (Playcode benchmark) (7 runs)
- Lighthouse on a headland at night (5 runs)
- Xbox 360 controller (5 runs)
- California brown pelican riding a bicycle (detailed spec) (5 runs)
- Fjord scene (Three.js) (1 run)
- BMW M4 Competition, side view (flat vector) (6 runs)
- Pelican riding a bicycle (control) (5 runs)