Compare models.
Every model on the bench, side by side on the same 30 tasks. Toggle entries off to focus the comparison.
By harness
The full matrix. Cell tint scales with the value; the strongest tint wins the row.
| harness |  DeepSeek V4 Pro |  GPT-6 Astra |
|---|---|---|
 Claude CodeAnthropic | 50.0%15/30 | 72.4%21/29 |
| CodexOpenAI | 53.3%16/30 | 75.9%22/29 |
 OpenCodeSST | 50.0%15/30 | 69.0%20/29 |
 Hermes AgentNous Research | 56.7%17/30 | 75.9%22/29 |
 Pi Agentpi.dev | 56.7%17/30 | 69.0%20/29 |
| DeepSeekDeepSeek | 53.3%16/30 | — |
 Command CodeCommand Code | 60.0%18/30 | 75.9%22/29 |
 ClineCline | 56.7%17/30 | 79.3%23/29 |
| Model | Claude Code | Codex | OpenCode | Hermes Agent | Pi Agent | DeepSeek | Command Code | Cline |
|---|---|---|---|---|---|---|---|---|
| DeepSeek V4 ProDeepSeek | 50.0%15/30 | 53.3%16/30 | 50.0%15/30 | 56.7%17/30 | 56.7%17/30 | 53.3%16/30 | 60.0%18/30 | 56.7%17/30 |
| GPT-6 AstraOpenAI | 72.4%21/29 | 75.9%22/29 | 69.0%20/29 | 75.9%22/29 | 69.0%20/29 | — | 75.9%22/29 | 79.3%23/29 |
Overall
Each column shows that model's selected results on Claude Code, across the same 30 tasks. Choose a harness to compare results across the suite.
DeepSeek V4 ProGPT-6 AstraShape by harness
Success rate on every harness, one polygon per entry.
DeepSeek V4 ProGPT-6 Astra
Claude Code50%72%
Codex53%76%
OpenCode50%69%
Hermes Agent57%76%
Pi Agent57%69%
DeepSeek53%
Command Code60%76%
Cline57%79%