How to integrate Humanloop MCP with Codex

Connect Codex to Humanloop MCP. Create a new project for sentiment analysis, delete your old prototype project permanently, and more using natural language, with authentication handled for you.

Humanloop logoHumanloop
Api Key

Humanloop is a platform for building and refining AI applications through user feedback and data annotation. It helps teams iterate on language model performance for more accurate and effective AI solutions.

4 Tools

Introduction

Codex is one of the most popular coding harnesses out there. And MCP makes the experience even better. With the Humanloop MCP integration, Codex can create and delete projects, list experiments, and review sessions, all without leaving the terminal or the app, whichever you prefer.

Also integrate Humanloop with

Why use Composio?

Apart from a managed and hosted MCP server, you will get:

  • CodeAct: A dedicated workbench that allows GPT to write its code to handle complex tool chaining. Reduces to-and-fro with LLMs for frequent tool calling.
  • Large tool responses: Handle them to minimise context rot.
  • Dynamic just-in-time access to 20,000 tools across 1700+ other Apps for cross-app workflows. It loads the tools you need, so GPTs aren't overwhelmed by tools you don't need.

How to install Humanloop MCP in Codex

Run the setup command

Run this command in your terminal to add the Composio MCP server to Codex.

Terminal

It will initiate the authentication in a browser window, authorize Codex to access your Composio account.

Composio authentication page

(Optional) Authenticate with OAuth

To authenticate manually, run the login command to open a browser window and authorize Codex to access your Composio account.

bash
codex mcp login composio

Verify the connection

Run codex mcp list to confirm Composio appears as a registered MCP server.

bash
codex mcp list

Codex App

Codex App follows the same approach as VS Code.

  1. Click ⚙️ on the bottom left → MCP Servers → + Add servers → Streamable HTTP:
  2. Fill the header and Key fields with { "x-consumer-api-key" = "ck_*******" }.
  3. The Key is the Composio API key, that you can find on dashboard.composio.dev
  4. Click on Authenticate and authorize Codex to your Composio account and you're all set.
Codex App MCP setup
  1. Restart and verify if it's there in .codex/config.toml
bash
[mcp_servers.composio]
url = "https://connect.composio.dev/mcp"
http_headers = { "x-consumer-api-key" = "ck_*******" }

Try it

Ask Codex for a Humanloop task. The first time, Composio asks you to connect your Humanloop account.

For example, ask it to:

  • "Create a new project for sentiment analysis"
  • "Delete your old prototype project permanently"
  • "List all experiments for project pr_12345"

What is the Humanloop MCP server, and what's possible with it?

The Humanloop MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your Humanloop account. It provides structured and secure access to your Humanloop projects, so your agent can perform actions like creating projects, managing experiments, and analyzing session data on your behalf.

  • Project creation and management: Let your agent spin up new Humanloop projects, add descriptions, and organize them for streamlined AI development.
  • Automated project deletion: Direct your agent to permanently remove projects, cleaning up experiments or outdated initiatives with a single command.
  • Experiment tracking and analysis: Easily retrieve and review all experiments within a project, including configurations, status, and results for continuous iteration and improvement.
  • Session history and monitoring: Ask your agent to list and analyze sessions for a given project, giving you insight into user interactions, datapoints, and evaluation history.

Conclusion

You've successfully integrated Humanloop with Codex using Composio's MCP server. Now you can interact with Humanloop directly from your terminal, VS Code, or the Codex App using natural language commands.

Key benefits of this setup:

  • Seamless integration across CLI, VS Code, and standalone app
  • Natural language commands for Humanloop operations
  • Managed authentication through Composio
  • Access to 20,000+ tools across 1700+ apps for cross-app workflows
  • CodeAct workbench for complex tool chaining

Next steps:

  • Try asking Codex to perform various Humanloop operations
  • Explore cross-app workflows by connecting more toolkits
  • Build automation scripts that leverage Codex's AI capabilities
TOOLS

Supported Tools

Every Humanloop action and event your agent gets out of the box.

Create Project

Creates a new Humanloop project using a required name and optional description and directory ID.

Delete Project

This tool allows you to delete a specific project from your Humanloop organization.

List Experiments

Retrieves an array of experiments associated with a Humanloop project identified by a project ID starting with 'pr_'.

List Sessions

This tool retrieves a paginated list of sessions for a specific project in Humanloop.

FAQ

Frequently asked questions

Start with Humanloop.It takes 30 seconds.

Managed auth, hosted MCP servers, and every Humanloop tool your agent needs.Free to start.

Start building