Gemini 3.8 Flash
Google. Run in Cline CLI, OpenCode. No access to its home CLI or through OpenCode (those planned slots show as not tested); tested through the Cline free tier from 2026-09-24.
16 runs on 12 prompts · 50% finished
Results
The best run of each of its 12 tests first, then every other run. Filter them in the explorer
8 finished runs
MacBook Pro 16" realistic 3D render (Playcode benchmark)
Gemini 3.8 Flash
Cline CLI 3.0.65
skills off
Failed · Did not finish
DualSense controller, max fidelity
Gemini 3.8 Flash
Cline CLI 3.0.65
skills off
Failed · Stopped by our timeout
MacBook Pro 16" realistic 3D render (Playcode benchmark)
Gemini 3.8 Flash
Cline CLI 3.0.65
skills off
Failed · Error
BMW M4 Competition, side view (flat vector)
Gemini 3.8 Flash
Cline CLI 3.0.65
skills off
Failed · Did not finish
BMW M4 Competition, side view (flat vector)
Gemini 3.8 Flash
Cline CLI 3.0.65
skills off
Failed · Did not finish
Numbers: finish rate, cost, wall time, draft scores
- Runs
- 16
- on 12 prompts
- Finished
- 50%
- 8 of 16
- Median cost, finished run
- $0
- n=3
- Median wall time, finished run
- 9m 44s
- n=8
- Recorded spend
- $0.073
- $0.073 on unfinished runs; 10 without a recorded cost
From the numbers
Set against the other models with at least 3 runs (top or bottom third), and its draft-score ranks within single prompts. Nothing here is averaged across prompts.
Strengths
- $0 (n=3): 1st of 14 models with at least 3 (median cost of a finished run)
Weaknesses
- 8 of 16 runs finished: 20th of 24 models with at least 3 (finish rate)
- 9m 44s (n=8): 17th of 23 models with at least 3 (median wall time of a finished run)
- 4 runs ended as the model's own failure (DNF, class MODEL)
- Other unfinished runs, not counted against the model: 3 INFRA, 1 TIMEOUT
Best and hardest run
Best run
Picked as its fastest finished run (no scored result yet).
-
Gemini 3.8 Flash, Cline CLI, Pelican riding a bicycle (control)
Cline CLI 3.0.65, high effort, via Google
skills off
6m 14s
$0 reported by Cline CLI
OK
Unscored: not judged yet
Hardest run
Picked as its costliest run that did not finish.
-
Did not finish · re-run queued
Gemini 3.8 Flash, OpenCode, BMW M4 Competition, side view (flat vector)
OpenCode 1.18.32, max effort, via Google
skills off
Error (infrastructure, not the model)
4m 29s $0.073 reported by OpenCode est. $0.073
Draft scores by prompt
No scored result yet (only prompts with a published rubric are scored).
By harness
| Cline CLI | 15 | 8 | 53% | $0 n=3 | 9m 44s n=8 |
|---|---|---|---|---|---|
| OpenCode | 1 | 0 | 0% | not recorded: no finished run with a recorded cost | not recorded: no finished run with a recorded time |
All 12 tests and experiment collections
- Pelican car france (1 run)
- Whale clouds (1 run)
- Isometric SVG town with sprite sheet (1 run)
- Animated pelican riding a bicycle (SMIL/CSS) (1 run)
- Xbox 360 controller (1 run)
- Lighthouse on a headland at night (1 run)
- California brown pelican riding a bicycle (detailed spec) (1 run)
- Pelican riding a bicycle (control) (1 run)
- DualSense controller, max fidelity (2 runs)
- MacBook Pro 16" realistic 3D render (Playcode benchmark) (2 runs)
- BMW M4 Competition, side view (flat vector) (3 runs)
- Dolphin vlog bicycle (1 run)
Experiment collections: SVG (16) · Harness lane (16) · Free lane (5)