How to integrate Bench MCP with Codex

Connect Codex to Bench MCP. Pause workflow for 10 seconds, simulate delay during test runs, and more using natural language, with authentication handled for you.

Bench logoBench
No Auth

Bench is a benchmarking tool for automated performance measurement and analysis. It helps you quickly evaluate, compare, and track your systems or workflows.

1 Tools

Introduction

Codex is one of the most popular coding harnesses out there. And MCP makes the experience even better. With the Bench MCP integration, Codex can pause execution for a set duration, all without leaving the terminal or the app, whichever you prefer.

For exact tool slugs and parameter tables, see the tool catalog in the Composio docs.

Also integrate Bench with

Why use Composio?

Apart from a managed and hosted MCP server, you will get:

  • CodeAct: A dedicated workbench that allows GPT to write its code to handle complex tool chaining. Reduces to-and-fro with LLMs for frequent tool calling.
  • Large tool responses: Handle them to minimise context rot.
  • Dynamic just-in-time access to 20,000 tools across 1700+ other Apps for cross-app workflows. It loads the tools you need, so GPTs aren't overwhelmed by tools you don't need.

How to install Bench MCP in Codex

Run the setup command

Run this command in your terminal to add the Composio MCP server to Codex.

Terminal

It will initiate the authentication in a browser window, authorize Codex to access your Composio account.

Composio authentication page

(Optional) Authenticate with OAuth

To authenticate manually, run the login command to open a browser window and authorize Codex to access your Composio account.

bash
codex mcp login composio

Verify the connection

Run codex mcp list to confirm Composio appears as a registered MCP server.

bash
codex mcp list

Codex App

Codex App follows the same approach as VS Code.

  1. Click ⚙️ on the bottom left → MCP Servers → + Add servers → Streamable HTTP:
  2. Fill the header and Key fields with { "x-consumer-api-key" = "ck_*******" }.
  3. The Key is the Composio API key, that you can find on dashboard.composio.dev
  4. Click on Authenticate and authorize Codex to your Composio account and you're all set.
Codex App MCP setup
  1. Restart and verify if it's there in .codex/config.toml
bash
[mcp_servers.composio]
url = "https://connect.composio.dev/mcp"
http_headers = { "x-consumer-api-key" = "ck_*******" }

Try it

Ask Codex for a Bench task. The first time, Composio asks you to connect your Bench account.

For example, ask it to:

  • "Pause workflow for 10 seconds"
  • "Simulate delay during test runs"
  • "Wait before running next benchmark"

What is the Bench MCP server, and what's possible with it?

The Bench MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to Bench. It provides structured and secure access to timed pauses, so your agent can wait, delay execution, pace workflows, and simulate processing time on your behalf.

  • Timed workflow pauses: Have your agent pause for a set duration before continuing its work.
  • Delayed task execution: Let the agent wait before starting the next step in a workflow.
  • Workflow pacing: Direct your agent to add controlled delays between consecutive tasks.
  • Timing tests: Instruct your agent to simulate processing time when testing agent behavior.

Conclusion

You've successfully integrated Bench with Codex using Composio's MCP server. Now you can interact with Bench directly from your terminal, VS Code, or the Codex App using natural language commands.

Key benefits of this setup:

  • Seamless integration across CLI, VS Code, and standalone app
  • Natural language commands for Bench operations
  • Managed authentication through Composio
  • Access to 20,000+ tools across 1700+ apps for cross-app workflows
  • CodeAct workbench for complex tool chaining

Next steps:

  • Try asking Codex to perform various Bench operations
  • Explore cross-app workflows by connecting more toolkits
  • Build automation scripts that leverage Codex's AI capabilities
TOOLS

Supported Tools

Every Bench action and event your agent gets out of the box.

Sleep

Sleep for a randomly selected duration from 0 to 60 seconds, then return the delay in seconds.

FAQ

Frequently asked questions

Start with Bench.It takes 30 seconds.

Managed auth, hosted MCP servers, and every Bench tool your agent needs.Free to start.

Start building