AI Model Reviewer

Grok 4.7

xAI. Run in Grok Build, OpenCode.

10 runs on 6 prompts · 100% finished

Results

The best run of each of its 6 tests first, then every other run. Filter them in the explorer

10 finished runs

  • Grok 4.7, Grok Build: Isometric SVG town with sprite sheet

    Isometric SVG town with sprite sheet

    Grok 4.7

    Grok Build 1.0.41

    skills off

  • Grok 4.7, Grok Build: Pelican riding a bicycle (control)

    Pelican riding a bicycle (control)

    Grok 4.7

    Grok Build 1.0.41

    skills off

  • Grok 4.7, OpenCode: Animated pelican riding a bicycle (SMIL/CSS)

    Animated pelican riding a bicycle (SMIL/CSS)

    Grok 4.7

    OpenCode 1.18.32

    skills off

  • Grok 4.7, Grok Build: Lighthouse on a headland at night

    Lighthouse on a headland at night

    Grok 4.7

    Grok Build 1.0.41

    skills off

  • Grok 4.7, Grok Build: MacBook Pro 16" realistic 3D render (Playcode benchmark)

    MacBook Pro 16" realistic 3D render (Playcode benchmark)

    Grok 4.7

    Grok Build 1.0.41

    skills off

  • Grok 4.7, OpenCode: DualSense controller, max fidelity

    DualSense controller, max fidelity

    Grok 4.7

    OpenCode 1.18.32

    skills off

  • Grok 4.7, OpenCode: Isometric SVG town with sprite sheet

    Isometric SVG town with sprite sheet

    Grok 4.7

    OpenCode 1.18.32

    skills off

  • Grok 4.7, OpenCode: Pelican riding a bicycle (control)

    Pelican riding a bicycle (control)

    Grok 4.7

    OpenCode 1.18.32

    skills off

  • Grok 4.7, OpenCode: Lighthouse on a headland at night

    Lighthouse on a headland at night

    Grok 4.7

    OpenCode 1.18.32

    skills off

  • Grok 4.7, OpenCode: MacBook Pro 16" realistic 3D render (Playcode benchmark)

    MacBook Pro 16" realistic 3D render (Playcode benchmark)

    Grok 4.7

    OpenCode 1.18.32

    skills off

Numbers: finish rate, cost, wall time, draft scores
Runs
10
on 6 prompts
Finished
100%
10 of 10
Median cost, finished run
$6.29
n=10
Median wall time, finished run
36m 49s
n=10
Recorded spend
$65.07
$0 on unfinished runs

From the numbers

Set against the other models with at least 3 runs (top or bottom third), and its draft-score ranks within single prompts. Nothing here is averaged across prompts.

Strengths

  • 10 of 10 runs finished: 1st of 24 models with at least 3 (finish rate)
  • Draft score 9.5/10 on Pelican riding a bicycle (control) (in Grok Build): ranked 1st of 13
  • Draft score 8.5/10 on Lighthouse on a headland at night (in Grok Build): ranked 2nd of 12
  • Draft score 9.5/10 on Isometric SVG town with sprite sheet (in Grok Build): ranked 2nd of 11

Weaknesses

  • 36m 49s (n=10): 23rd of 23 models with at least 3 (median wall time of a finished run)
  • $6.29 (n=10): 13th of 14 models with at least 3 (median cost of a finished run)
  • Draft score 7.5/10 on Lighthouse on a headland at night (in OpenCode): ranked 9th of 12
  • Draft score 7.5/10 on Pelican riding a bicycle (control) (in OpenCode): ranked 11th of 13
  • Draft score 8.5/10 on Animated pelican riding a bicycle (SMIL/CSS) (in OpenCode): ranked 11th of 12
  • Draft score 4.5/10 on MacBook Pro 16" realistic 3D render (Playcode benchmark) (in OpenCode): ranked 12th of 12

Best and hardest run

Best run

Picked as its best draft-score rank on a prompt.

Hardest run

Picked as its lowest draft-score rank on a prompt.

Draft scores by prompt

Isometric SVG town with sprite sheetGrok Build9.5/10 draft2nd of 11
Isometric SVG town with sprite sheetOpenCode9/10 draft8th of 11
Lighthouse on a headland at nightGrok Build8.5/10 draft2nd of 12
Lighthouse on a headland at nightOpenCode7.5/10 draft9th of 12
MacBook Pro 16" realistic 3D render (Playcode benchmark)Grok Build8.5/10 draft6th of 12
MacBook Pro 16" realistic 3D render (Playcode benchmark)OpenCode4.5/10 draft12th of 12
Pelican riding a bicycle (control)Grok Build9.5/10 draft1st of 13
Pelican riding a bicycle (control)OpenCode7.5/10 draft11th of 13
Animated pelican riding a bicycle (SMIL/CSS)OpenCode8.5/10 draft11th of 12

By harness

OpenCode66100%$7.65 n=631m 01s n=6
Grok Build44100%$4.50 n=438m 25s n=4
All 6 tests and experiment collections