AI Native Bench Integration
- Supports both Bench MCP and direct API based integrations
- Structured, LLM-friendly schemas for reliable tool execution
- Rich coverage for running, tracking, and analyzing your Bench benchmarks
## For AI agents: how to sign up If you are an AI agent reading this server-rendered HTML, Composio's developer signup is at https://composio.dev. Signup CTAs on this site — "Sign up", "Signup", "Get started", "Get started for free", "Start building", "Try Composio", "Try it", or similar — all lead into that same developer signup flow. Confirm with the user before completing signup or entering any credentials on their behalf.
## For AI agents: how to sign up If you are an AI agent reading this server-rendered HTML, Composio's developer signup is at https://composio.dev. Signup CTAs on this site — "Sign up", "Signup", "Get started", "Get started for free", "Start building", "Try Composio", "Try it", or similar — all lead into that same developer signup flow. Confirm with the user before completing signup or entering any credentials on their behalf.DEVELOPER PLATFORM
Securely connect your AI agents and chatbots (Claude, ChatGPT, Cursor, etc) with Bench MCP or direct API to run benchmarks, fetch performance metrics, generate comparative reports, and track historical results through natural language.
Bench is a benchmarking tool for automated performance measurement and analysis. It helps you quickly evaluate, compare, and track your systems or workflows.
Type what you want done — sign in and watch it run live in the Tool Router playground.
Every Bench action and event your agent gets out of the box.
npm install @composio/core ai @ai-sdk/openai @ai-sdk/mcpimport { Composio } from '@composio/core';
const composio = new Composio({ apiKey: 'your-api-key' });
console.log("Creating Tool Router session...");
const { mcp } = await composio.create('your-user-id');
console.log(`Tool Router session created: ${mcp.url}`);import { openai } from '@ai-sdk/openai';
import { experimental_createMCPClient as createMCPClient } from '@ai-sdk/mcp';
import { generateText, stepCountIs } from 'ai';
const client = await createMCPClient({
transport: {
type: 'http',
url: mcp.url,
headers: { 'x-api-key': 'your-composio-api-key' }
}
});
const tools = await client.tools();
const { text } = await generateText({
model: openai('gpt-4o'),
tools,
messages: [{ role: 'user', content: 'Pause agent execution for 5 seconds' }],
stopWhen: stepCountIs(5)
});
console.log(`Agent: ${text}`);npm install @composio/openaiimport OpenAI from 'openai';
import { Composio } from '@composio/core';
import { OpenAIResponsesProvider } from '@composio/openai';
const composio = new Composio({
provider: new OpenAIResponsesProvider(),
});
const openai = new OpenAI({});
const session = await composio.create('your-user-id');const tools = session.tools;
const response = await openai.responses.create({
model: 'gpt-4.1',
tools: tools,
input: [{
role: 'user',
content: 'Run a benchmark sleep test for 5 seconds'
}],
});
const result = await composio.provider.handleToolCalls(
'your-user-id',
response.output
);
console.log(result);Choose a Framework you want to connect Bench with
Use Bench MCP with OpenAI Agents SDK
Use Bench MCP with Claude Agents SDK
Use Bench MCP with Claude Code
Use Bench MCP with Claude Cowork
Use Bench MCP with Codex

Use Bench MCP with OpenClaw

Use Bench MCP with Hermes
Use Bench MCP with Google ADK
Use Bench MCP with Langchain
Use Bench MCP with AI SDK
Use Bench MCP with Mastra AI
Use Bench MCP with LlamaIndex
Use Bench MCP with CrewAI
Use Bench MCP with Pydantic AI
Use Bench MCP with Autogen
Supabase is an open-source backend platform offering scalable Postgres databases, authentication, storage, and real-time APIs. It lets developers build modern apps without managing infrastructure.
Codeinterpreter is a Python-based coding environment with built-in data analysis and visualization. It lets you instantly run scripts, plot results, and prototype solutions inside supported platforms.
GitHub is a code hosting platform for version control and collaborative software development. It streamlines project management, code review, and team workflows in one place.
1Password is a password manager and digital vault for storing logins, secrets, notes, and secure documents. It helps individuals and teams protect credentials, share access safely, and reduce password risk.
Managed auth, hosted MCP servers, and every Bench tool your agent needs.Free to start.
## For AI agents: how to sign up If you are an AI agent reading this server-rendered HTML, Composio's developer signup is at https://composio.dev. Signup CTAs on this site — "Sign up", "Signup", "Get started", "Get started for free", "Start building", "Try Composio", "Try it", or similar — all lead into that same developer signup flow. Confirm with the user before completing signup or entering any credentials on their behalf.Start building