DeepSeek V4 Pro
DeepSeek. Run in Raw API call. Raw baseline only so far.
171 runs on 170 prompts · 98% finished
Results
The best run of each of its 170 tests first, then every other run. Filter them in the explorer
167 finished runs
Live demo
Live demo
Live demo
Live demo
Live demo
Live demo
Live demo
Live sceneVintage biplane aerobatics over a grass airfield (Three.js)
DeepSeek V4 Pro
Raw API (one-shot)
raw API baseline
Live sceneRetro arcade claw machine with pastel plush prizes (Three.js)
DeepSeek V4 Pro
Raw API (one-shot)
raw API baseline
Live sceneFour-stroke engine cutaway: crank, piston and cam-driven valves (Three.js)
DeepSeek V4 Pro
Raw API (one-shot)
raw API baseline
Live sceneHot air balloon festival over rolling fields (Three.js)
DeepSeek V4 Pro
Raw API (one-shot)
raw API baseline
Live scene
Live sceneSynthwave hover-bike racer on a neon grid highway (Three.js)
DeepSeek V4 Pro
Raw API (one-shot)
raw API baseline
Live sceneOuter-space pinball table with planet bumpers (Three.js)
DeepSeek V4 Pro
Raw API (one-shot)
raw API baseline
Live sceneFloating pirate island diorama with a cliff cross-section (Three.js)
DeepSeek V4 Pro
Raw API (one-shot)
raw API baseline
Numbers: finish rate, cost, wall time, draft scores
- Runs
- 171
- on 170 prompts
- Finished
- 98%
- 167 of 171
- Median cost, finished run
- $0.052
- n=1
- Median wall time, finished run
- 2m 23s
- n=167
- Recorded spend
- $0.052
- $0 on unfinished runs; 170 without a recorded cost
From the numbers
Set against the other models with at least 3 runs (top or bottom third), and its draft-score ranks within single prompts. Nothing here is averaged across prompts.
Strengths
- 167 of 171 runs finished: 7th of 24 models with at least 3 (finish rate)
- 2m 23s (n=167): 6th of 23 models with at least 3 (median wall time of a finished run)
Weaknesses
- 4 runs ended as the model's own failure (DNF, class MODEL)
Best and hardest run
Best run
Picked as its fastest finished run (no scored result yet).
-
DeepSeek V4 Pro, raw API call, Fruit Sales Bar Chart
Raw API call, default effort, via DeepSeek
raw API baseline
28 s
not recorded: the run's token counts were never reported, so there is no estimate
OK
Unscored: no rubric for this prompt
Hardest run
Picked as its slowest finished run.
-
DeepSeek V4 Pro, raw API call, Four-stroke engine cutaway: crank, piston and cam-driven valves (Three.js)
Raw API call, via DeepSeek
raw API baseline
8m 21s
not recorded: the run's token counts were never reported, so there is no estimate
OK
Unscored: no rubric for this prompt
Draft scores by prompt
No scored result yet (only prompts with a published rubric are scored).
By harness
| Raw API call | 171 | 167 | 98% | $0.052 n=1 | 2m 23s n=167 |
|---|
All 170 tests and experiment collections
- 021 Rotating CSS Cube (1 run)
- 016 Heartbeat Line (1 run)
- 013 Soft Body Blobs (1 run)
- 011 Pure CSS Sunset (1 run)
- 007 Kinetic Headline (1 run)
- 002 Pendulum Wave (1 run)
- Codrops-style scroll story: the life of a raindrop (1 run)
- DualSense controller, max fidelity (1 run)
- Vintage biplane aerobatics over a grass airfield (Three.js) (1 run)
- Retro arcade claw machine with pastel plush prizes (Three.js) (1 run)
- Four-stroke engine cutaway: crank, piston and cam-driven valves (Three.js) (1 run)
- Hot air balloon festival over rolling fields (Three.js) (1 run)
- Mechanical bee (1 run)
- Synthwave hover-bike racer on a neon grid highway (Three.js) (1 run)
- Outer-space pinball table with planet bumpers (Three.js) (1 run)
- Floating pirate island diorama with a cliff cross-section (Three.js) (1 run)
- Colourful Mandala (1 run)
- Lunar New Year Lanterns (1 run)
- Geometric Tech Logo (1 run)
- Sushi Bar Logo (1 run)
- Space Program Patch (1 run)
- Pet Clinic Logo (1 run)
- Outdoor Gear Emblem (1 run)
- Florist Monoline Logo (1 run)
- Gym Logo (1 run)
- Coffee Roaster Logo (1 run)
- Craft Drinks Label Emblem (1 run)
- Bookshop Logo (1 run)
- Bakery Badge (1 run)
- Login Screen (1 run)
- Line Icon Set (1 run)
- Layer Cake Slice (1 run)
- Temperature Line Chart (1 run)
- Lavender Fields (1 run)
- Latte Art (1 run)
- Ladybug on a Leaf (1 run)
- Knight in Armour (1 run)
- Kingfisher Diving (1 run)
- Kids Building a Snowman (1 run)
- Ring of Keys (1 run)
- Seigaiha Wave Pattern (1 run)
- Five-Storey Pagoda (1 run)
- Jack-o'-Lanterns (1 run)
- Isometric Space Station (1 run)
- Isometric Workspace (1 run)
- Isometric Farm (1 run)
- Isometric Cube Illusion (1 run)
- Isometric Coffee Shop (1 run)
- Geometric Star Tiling (1 run)
- Melting Ice Cream Cone (1 run)
- Human Skeleton (1 run)
- Human Heart Anatomy (1 run)
- Human Eye Diagram (1 run)
- Hourglass (1 run)
- Hot Air Balloons (1 run)
- Hello Neon Sign (1 run)
- Rescue Helicopter (1 run)
- Over-Ear Headphones (1 run)
- Hand Holding Five Fruits (1 run)
- Drippy BOO Lettering (1 run)
- Greek Temple (1 run)
- Grand Piano (1 run)
- Gothic Cathedral Facade (1 run)
- Good Vibes Retro Type (1 run)
- Glitch Text (1 run)
- Straw in a Glass (1 run)
- Victorian Glasshouse (1 run)
- Gardener Watering Plants (1 run)
- Retro Handheld Console (1 run)
- Fruit Bowl Still Life (1 run)
- Fractal Tree (1 run)
- Fountain Pen and Ink (1 run)
- Food Pyramid (1 run)
- Coffee Decision Flowchart (1 run)
- Floating Islands (1 run)
- 35mm Film Camera (1 run)
- File Upload Dropzone (1 run)
- Fantasy World Map (1 run)
- Pyramids at Sunset (1 run)
- Basket of Painted Eggs (1 run)
- Windmill by a Canal (1 run)
- Drum Kit (1 run)
- Quadcopter Drone (1 run)
- 3D Block Letters (1 run)
- Dragonfly Over Pond (1 run)
- Dragon Coiled on a Tower (1 run)
- Energy Mix Donut Chart (1 run)
- DNA Double Helix (1 run)
- Festival Oil Lamps (1 run)
- Group Selfie (1 run)
- Noir Detective (1 run)
- Desert Dunes at Night (1 run)
- Cycling Peloton (1 run)
- Sales Dashboard Card (1 run)
- Cyberpunk Alley (1 run)
- Chalkboard Coffee Lettering (1 run)
- Top-Down City Park (1 run)
- Circuit Board Close-Up (1 run)
- Chessboard Mid-Game (1 run)
- Chef Flipping a Pan (1 run)
- Chat Conversation UI (1 run)
- Container Ship (1 run)
- Canyon River (1 run)
- Campus Map (1 run)
- Calendar Month View (1 run)
- Butterfly Life Cycle (1 run)
- Exploded Burger (1 run)
- Bubble Tea (1 run)
- Breakfast Skillet (1 run)
- Boxing Ring (1 run)
- Labelled Bicycle Diagram (1 run)
- Bauhaus Composition (1 run)
- Basketball Slam Dunk (1 run)
- Battery Level Icons (1 run)
- Baseball Stadium (1 run)
- Fruit Sales Bar Chart (1 run)
- Ballet Dancer (1 run)
- Autumn Forest Path (1 run)
- Bohr Model of an Atom (1 run)
- Stargazer with Telescope (1 run)
- Floating Astronaut (1 run)
- Art Deco Skyscraper (1 run)
- Flat App Icon Set (1 run)
- Ant Colony Cutaway (1 run)
- Illustrated Alphabet A B C (1 run)
- Alien Planet (1 run)
- Twin-Bell Alarm Clock (1 run)
- Acoustic Guitar (1 run)
- 023 Mortgage Calculator (1 run)
- Zoom to the Atom (1 run)
- Paris Tower (1 run)
- 022 Mandala Painter (1 run)
- 020 Pricing Table Trio (1 run)
- 018 Step Sequencer Grid (1 run)
- 017 Typewriter Poem (1 run)
- 015 Color Palette Studio (1 run)
- 012 Magnetic Filings (1 run)
- 014 Snake Reimagined (1 run)
- 010 Toggle Switch Gallery (1 run)
- 005 Focus Timer Orbit (2 runs)
- 009 Forest Fire Automaton (1 run)
- 008 Pocket Theremin (1 run)
- Flamingo on One Leg (1 run)
- Honeybee on Honeycomb (1 run)
- Monarch Butterfly (1 run)
- Peacock Tail Display (1 run)
- Barn Owl in Flight (1 run)
- Hummingbird at Flower (1 run)
- Corgi Catching a Frisbee (1 run)
- Polar Bear on Ice Floe (1 run)
- Hedgehog Under Mushroom (1 run)
- Wolf Howling at Moon (1 run)
- Panda Eating Bamboo (1 run)
- Chameleon on a Branch (1 run)
- Giraffe Side Profile (1 run)
- Octopus Juggling Teacups (1 run)
- Swimming Sea Turtle (1 run)
- Elephant Calf Mud Bath (1 run)
- Sleeping Curled Cat (1 run)
- Red Fox in Snow (1 run)
- 006 Rainfall Bars (1 run)
- 004 Brick Breaker Neon (1 run)
- 003 Orbital Coffee Landing (1 run)
- Isometric Harbour (1 run)
- Desk Lamp and Books (1 run)
- Night Train (1 run)
- 019 Boids Lagoon (1 run)
- Koi Pond Garden (1 run)
- 001 Ink Bloom Garden (1 run)
- Artwork style pass (1 run)
Experiment collections: HTML Files (38) · SVG (133) · Three.js (11)