DeepSeek V4 Pro

DeepSeek#2 of 2 by best run
Compare models
Best success60%in Command Code
Cheapest run$0.10per task in Codex
Fastest run375sper task in Command Code
Best harness
Command Code
Graded runs
7 of 7 harnesses
Latest run
2026-09-04

Success rate

% of tasks passed by harness · higher is better
Command Code
60.0%
Hermes Agent
56.7%
Pi Agent
56.7%
Codex
53.3%
DeepSeek
53.3%
Claude Code
50.0%
OpenCode
50.0%

Time per task

Seconds per task by harness · lower is better
Command Code
375s
DeepSeek
388s
OpenCode
403s
Claude Code
414s
Hermes Agent
447s
Pi Agent
459s
Codex
482s

Runs

  1. 01Command Code
    60%
    $ / task$0.11Time / task375s
  2. 02Hermes Agent
    57%
    $ / task$0.15Time / task447s
  3. 03Pi Agent
    57%
    $ / task$0.16Time / task459s
  4. 04Codex
    53%
    $ / task$0.10Time / task482s
  5. 05DeepSeek
    53%
    $ / task$0.12Time / task388s
  6. 06Claude Code
    50%
    $ / task$0.25Time / task414s
  7. 07OpenCode
    50%
    $ / task$0.16Time / task403s