LongCat 2.5 Preview
Meituan. Run in OpenCode. OpenCode Zen free route (longcat-2.5-preview-free).
52 runs on 50 prompts · 81% finished
Results
The best run of each of its 50 tests first, then every other run. Filter them in the explorer
42 finished runs
Islamic star tiling (agent version)
LongCat 2.5 Preview
OpenCode 1.18.32
skills off
Failed · Stopped by us
GPU fluid sim
LongCat 2.5 Preview
OpenCode 1.18.32
skills off
Failed · Stopped by us
The model's code errors on load: ambientTime is not defined
City park top down (agent version)
LongCat 2.5 Preview
OpenCode 1.18.32
skills off
Failed · Stopped by us
Numbers: finish rate, cost, wall time, draft scores
- Runs
- 52
- on 50 prompts
- Finished
- 81%
- 42 of 52
- Median cost, finished run
- $0
- n=42
- Median wall time, finished run
- 9m 18s
- n=42
- Recorded spend
- $0
- $0 on unfinished runs
From the numbers
Set against the other models with at least 3 runs (top or bottom third), and its draft-score ranks within single prompts. Nothing here is averaged across prompts.
Strengths
- $0 (n=42): 1st of 14 models with at least 3 (median cost of a finished run)
Weaknesses
- Other unfinished runs, not counted against the model: 2 INFRA, 8 TIMEOUT
Best and hardest run
Best run
Picked as its fastest finished run (no scored result yet).
-
LongCat 2.5 Preview, OpenCode, svg_weather_widget__agent
OpenCode 1.18.32, max effort
skills off
1m 38s
$0 reported by OpenCode
OK
Unscored: no rubric for this prompt
Hardest run
Picked as its slowest finished run.
-
LongCat 2.5 Preview, OpenCode, svg_logo_sushi_bar__agent
OpenCode 1.18.32, max effort
skills off
37m 57s
$0 reported by OpenCode
OK
Unscored: no rubric for this prompt
Draft scores by prompt
No scored result yet (only prompts with a published rubric are scored).
By harness
| OpenCode | 52 | 42 | 81% | $0 n=42 | 9m 18s n=42 |
|---|
All 50 tests and experiment collections
- Soccer bicycle kick (agent version) (1 run)
- Treasure map (agent version) (1 run)
- Voronoi cells (agent version) (1 run)
- Human heart anatomy (agent version) (1 run)
- Human skeleton front (agent version) (1 run)
- Food pyramid (agent version) (1 run)
- Grand piano (agent version) (1 run)
- Logo sushi bar (agent version) (1 run)
- Hand five fruits (agent version) (1 run)
- Vinyl turntable (agent version) (1 run)
- Boxing ring (agent version) (1 run)
- Water cycle diagram (agent version) (1 run)
- Logo coffee roaster (agent version) (1 run)
- Hello neon sign (agent version) (1 run)
- Halloween drippy boo (agent version) (1 run)
- Dragon sleeping castle (agent version) (1 run)
- Detective noir (agent version) (1 run)
- Japanese pagoda (agent version) (1 run)
- Chat interface (agent version) (1 run)
- Suspension bridge fog (agent version) (1 run)
- Astronaut floating (agent version) (1 run)
- Sewing machine (agent version) (1 run)
- Weather widget (agent version) (1 run)
- Latte art (agent version) (1 run)
- Swiss army knife (agent version) (1 run)
- Mountain lake dawn (agent version) (1 run)
- Rice terraces (agent version) (1 run)
- Sushi platter (agent version) (1 run)
- Retro crt computer (agent version) (1 run)
- Film camera (agent version) (1 run)
- Steam locomotive (agent version) (1 run)
- Hummingbird flower (agent version) (1 run)
- Ladybug leaf (agent version) (1 run)
- Cargo ship containers (agent version) (1 run)
- Panda bamboo (agent version) (1 run)
- Red fox snow (agent version) (1 run)
- Isometric SVG town with sprite sheet (1 run)
- Dolphin vlog bicycle (1 run)
- California brown pelican riding a bicycle (detailed spec) (1 run)
- Pelican riding a bicycle (control) (1 run)
- Pelican car france (1 run)
- Whale clouds (1 run)
- Jack o lanterns (agent version) (1 run)
- Islamic star tiling (agent version) (1 run)
- GPU fluid sim (2 runs)
- City park top down (agent version) (1 run)
- Cyberpunk alley (agent version) (1 run)
- Momijigari (1 run)
- X16 engine (1 run)
- Tidewater (2 runs)
Experiment collections: HTML Files (6) · SVG (46) · Three.js (6) · Free lane (52)