ComposioBENCH
Try Bench

Pi Agent

pi.dev#7 of 8 by coverage
Compare harnesses
Best success69%with GPT-6 Astra
Fastest run128sper task with GPT-6 Astra
Model support
Open
Graded runs
2 of 2 models
Latest run
2026-10-15

Success rate

% of tasks passed by model · higher is better
GPT-6 Astra
69.0%
DeepSeek V4 Pro
56.7%

Time per task

Seconds per task by model · lower is better
GPT-6 Astra
128s
DeepSeek V4 Pro
459s

Runs

  1. 01GPT-6 Astra
    69%
    Time / task128s
  2. 02DeepSeek V4 Pro
    57%
    Time / task459s