AI Model Reviewer

DeepSeek V4.1 Flash in dsh 0.1.5-rc.3

skills off

← Open in the gallerySame prompt, all models

Zoom, inline player and more ways to view
DeepSeek V4.1 Flash's SVG for Pelican riding a bicycle (control)

OKPelican riding a bicycle (control)max effortHome harness

Wall time 7m 48sCost $0.075 estimated7.0/10 · Draft score — AI judge

Review

Colourful and cheerful (red cap, water bottle, road, sun glow), but the bird is closer to a stork or goose and floats above the bike instead of sitting on the saddle. The legs connect to the pedals in a stiff, broken way.

Verdict by the AI judge (provisional).

The full review

OK. Finished on its own after 7.8 min and produced pelican.svg.

Bugs

  • Body hovers above the saddle, no seat contact
  • Legs are stiff tubes; near leg bends the wrong way
  • Neck/beak proportions read as stork, pouch small

Scores

AI judge

7.0/10

Draft score — AI judge

Visitor votes and reviewer grades are not available yet.

CriterionMarks
pelican1.5
bicycle1.5
riding1
composition2
craft1
Total (sum of the marks)7 / 10
AI judge
AI judge: the test runner (model claude-opus-5-5), scoring by visual review of the 1600 px render against the pre-registered rubric. A draft score until the reviewer checks it. Rubric: Wave-1 SVG scoring rubric (AI Model Reviewer).
Visitors
Public voting with a blind reveal is coming: you score the output first, then see the other scores.
Reviewer
The reviewer's own grade appears here once it is added.

Scores compare results for the same prompt only. AI-judge boards rank runs within one prompt, equal totals sharing a rank; scores from different prompts are never averaged.

Downloads

Files actually published for this run. Original output, site-made previews and post-run conversions are labelled separately.

The exact prompt

agentic harness (save the file; self-render allowed), 234 characters. Every result for this prompt

Generate an SVG of a pelican riding a bicycle. Save it as pelican.svg in the current directory. You may render and inspect your own output (headless chromium is available at /usr/bin/chromium) and iterate on your own before finishing.

How it was made

Wall time 7m 48s2 saved versions

Versions saved during the run

2 intermediate outputs, in the order the model wrote them.

Version 2 of 2
  1. Version 1 at 6m 39s thumbnailv1 6:39
  2. Version 2 at 7m 41s thumbnailv2 7:41

Step by step

The prompt, every agent turn and tool call (tool name and a one-line summary; inputs and outputs are not shown), then the final message. The full machine-format transcript is published as a scrubbed download.

Show all 76 steps

Loading the timeline…

Download the full transcript dsh session log, 2.0 MB. Scrubbed: anything that looks like a key, token, e-mail address or phone number is replaced, and account details and the test machine's file paths are removed.

Cost breakdown

Headline cost $0.075, estimated from the token counts at list price.

Tokens by typeTokens$ per 1MCost
Input (uncached)24,556$0.15$0.0037
Cache write0$0.15$0
Cache read3,102,976$0.00$0.0093
Output103,534$0.60$0.0621
of which reasoning45,362billed as output
Total computed from tokens
$0.0751
Total reported by the harness
none

Tokens summed from the dsh session log per-step usage (inputTokens = uncached); dsh prints no cost.

Prices: api-docs.deepseek.com/quick_start/pricing (read 2026-09-23); off-peak rates, peak (weekdays 01-04 and 06-10 UTC) is 2x, 2026-09-23.

Run notes

one prompt, agentic harness (self-review allowed)wave 1

  • a well-known benchmark wording "Generate an SVG of a pelican riding a bicycle" (a full stop added before the harness suffix).
  • run started off-peak: off-peak rates
  • Mode: headless mode (dsh ships no terminal UI; its interactive UI is a web app) — dsh --profile headless, inside bubblewrap
  • Isolation: bwrap: private /tmp, HOME/TMPDIR/DSH_HOME inside run dir; the project files, other runs, /tmp/hx_* not mounted