ComposioBENCH
Try Bench

Codex

OpenAI#1 of 7 by coverage
Compare harnesses
Best success72%with GPT-6 Astra
Cheapest run$0.10per task with DeepSeek V4 Pro
Fastest run151sper task with GPT-6 Astra
Model support
Open
Graded runs
2 of 2 models
Latest run
2026-09-10

Success rate

% of tasks passed by model · higher is better
GPT-6 Astra
72.4%
DeepSeek V4 Pro
53.3%

Cost per task

USD per task by model · lower is better
DeepSeek V4 Pro
$0.10
GPT-6 Astra
$1.63

Time per task

Seconds per task by model · lower is better
GPT-6 Astra
151s
DeepSeek V4 Pro
482s

Runs

  1. 01GPT-6 Astra
    72%
    $ / task$1.63Time / task151s
  2. 02DeepSeek V4 Pro
    53%
    $ / task$0.10Time / task482s