X (Twitter)LinkedInGitHubDiscordYouTube

How to connect Braintrust to Claude

Connect Claude Web, Desktop and Cowork to Braintrust MCP. Compare failed evaluations across recent experiments, create dataset from production failure logs, and more using natural language, with authentication handled for you.

Get started for freeGet a demo
Braintrust logoBraintrust
Api Key

Braintrust is an AI engineering platform for prompts, datasets, experiments, evaluations, observability, and production AI apps. Use it to ship better AI systems with faster debugging, clearer evals, and tighter feedback loops.

17 Tools

Introduction

Claude is Anthropic's AI assistant, available on the web, in the desktop app, and on mobile. Cowork is its agent for knowledge work, and it runs on all of those surfaces too. Connected to your apps, Claude can work with your files and services to accomplish complex tasks on your behalf.

This guide walks you through the easiest and most secure way to connect your Braintrust account to Claude via Composio Connect, enabling it to compare failed evaluations across recent experiments, create dataset from production failure logs, summarize latency spikes in Braintrust traces, and more such actions on your behalf without compromising your account security.

Setup is the same on Claude Web, Desktop, and Cowork, and you only need to do it once. The connector is tied to your account, so it's available in all three.

Also integrate Braintrust with

ChatGPTHermesAtomic Agent

Connecting Braintrust to Claude Web, Desktop, and Cowork

Two ways to add the Composio connector. Pick whichever you prefer.

1. Add with one click

Click the button. Claude opens with the Composio connector filled in. Click Add, then go to step 2.

Add to Claude

Add manually

In Claude Desktop, click Customize in the left sidebar, then select Connectors and click the + icon at the top.

Claude Desktop connectors screen with Add custom connector selected

Click Add custom connector and paste in the Composio MCP server URL:

bash
https://connect.composio.dev/mcp
Add custom connector dialog with Composio MCP server URL

2. Authorize in your browser

Click Connect. You'll be redirected to a browser window where you can authorize Composio to continue.

Composio authorization screen for Claude Web, Desktop, and Cowork

3. Connect your Braintrust account

Back in Claude, ask it to connect to Braintrust or give it any Braintrust-related task.

For example, ask Claude to:

  • "Compare failed evaluations across recent experiments"
  • "Create dataset from production failure logs"
  • "Summarize latency spikes in Braintrust traces"

It will prompt you to authenticate and authorize access.

That's it. Composio's tools are now available in Claude, and your Braintrust account is ready to use.

What is the Braintrust Claude Connector, and what's possible with it?

The Braintrust MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your Braintrust account. It provides structured and secure access so your agent can perform Braintrust operations on your behalf.

Troubleshooting

1. Why does Claude not use the Composio connector for Braintrust?

The connector can show as connected, but Claude must use it in each Braintrust conversation.

  • Click + at the lower left of the chat, or type /.
  • Hover Connectors.
  • Turn on Composio.
  • Ask Claude to connect to Braintrust again.

2. Why does Claude show an MCP server error before Braintrust connects?

Claude can show Couldn't reach the MCP server or Authorization with the MCP server failed when you add the connector for Braintrust.

  • Check that the connector URL is https://connect.composio.dev/mcp.
  • Connectors run from Anthropic's cloud, so your device network is usually not the problem.
  • Add the connector again from Customize > Connectors, then ask Claude to connect Braintrust.
  • If it fails again, send the error and the ofid_ reference id to support@composio.dev.

3. Why does the Braintrust authorization link not work?

The Composio connector is one server. Your Braintrust account connects separately when Claude asks for it.

  • If the browser does not open, or the link expires, ask Claude to retry the Braintrust connection.
  • Composio creates a fresh Braintrust authorization link.
  • Open that link in your browser and finish the Braintrust sign-in.

4. Why do Braintrust actions fail after they worked before?

The Braintrust connection can expire or lose permission.

  • Ask Claude to inspect the Braintrust connection.
  • If the connection is unhealthy, disconnect it when Claude prompts you.
  • Reconnect the Braintrust account and retry the action.
  • If Claude shows a permission prompt, approve it before Claude changes data in Braintrust.
  • If the action still fails with a permission error, check that the connected account has that permission in Braintrust itself.

5. How do I switch to a different Braintrust account?

Claude can manage the Braintrust connection for you.

  • Ask Claude to disconnect or delete the current Braintrust account.
  • Ask Claude to connect Braintrust again.
  • Open the new Composio authorization link for Braintrust.
  • Sign in with the other Braintrust account in the browser.
  • After the account connects, ask Claude to retry the Braintrust task.

6. Why is my Braintrust connection missing in Claude Desktop or on a Team plan?

The connector belongs to your Claude account, so your Braintrust connection works in Claude Web, Desktop, and Cowork.

  • In Claude Desktop, open Customize > Connectors.
  • Next to Composio, click ⋮ and click Clear cache.
  • If Braintrust tools still do not appear, click ⋮, disconnect, remove the connector, and add it again.
  • On Team or Enterprise, an Owner or Primary Owner must enable the connector before you can connect Braintrust.
TOOLS

Supported Tools

Every Braintrust action and event your agent gets out of the box.

Create Dataset

Create a named dataset under a Braintrust project, or return the existing dataset unchanged when its name already exists in that project.

Create Experiment

Create an experiment under a Braintrust project.

Create Project

Create a Braintrust project, or return the existing project unchanged when its name already exists.

Create Prompt

Upsert a versioned prompt configuration under a Braintrust project without invoking it.

Delete Project

Soft-delete a Braintrust project and return its deletion state.

Delete Experiment, Dataset, or Prompt

Delete one Braintrust experiment, dataset, or prompt by UUID for explicit lifecycle cleanup.

Fetch Events

Fetch one newest-to-oldest page of project log, experiment, or dataset events.

Get Braintrust Resource

Get one project, experiment, dataset, prompt, or function by UUID.

Insert Dataset Events

Upsert a batch of examples into an existing Braintrust dataset.

Insert Experiment Events

Upsert a batch of result events into an existing Braintrust experiment.

List Braintrust Resources

List and filter one page of projects, experiments, datasets, prompts, or functions visible to the connected Braintrust API key.

Query Braintrust Data

Run one bounded synchronous read-only BTQL query over Braintrust project logs, an experiment, or a dataset.

Summarize Experiment or Dataset

Return metadata and optional aggregate summaries for one Braintrust experiment or dataset.

Update Dataset

Update the name, description, tags, or metadata of a Braintrust dataset.

Update Experiment

Update selected metadata and linkage fields on a Braintrust experiment.

Update Project

Update selected fields of a Braintrust project.

Update Prompt

Update a Braintrust prompt's metadata or configuration without invoking it.

FRAMEWORKS

How to build Braintrust MCP Agent with another framework

ChatGPT logo

ChatGPT

Use Braintrust MCP with ChatGPT

Hermes logo

Hermes

Use Braintrust MCP with Hermes

Atomic Agent logo

Atomic Agent

Use Braintrust MCP with Atomic Agent

FAQ

Frequently asked questions

With a standalone Braintrust MCP server, the agents and LLMs can only access a fixed set of Braintrust tools tied to that server. However, with the Composio Tool Router, agents can dynamically load tools from Braintrust and many other apps based on the task at hand, all through a single MCP endpoint.

Yes, you can. Claude Cowork fully supports MCP integration. You get structured tool calling, message history handling, and model orchestration while Tool Router takes care of discovering and serving the right Braintrust tools.

Yes, absolutely. You can configure which Braintrust scopes and actions are allowed when connecting your account to Composio. You can also bring your own OAuth credentials or API configuration so you keep full control over what the agent can do.

All sensitive data such as tokens, keys, and configuration is fully encrypted at rest and in transit. Composio is SOC 2 Type 2 compliant and follows strict security practices so your Braintrust data and credentials are handled as safely as possible.

Start with Braintrust.It takes 30 seconds.

Managed auth, hosted MCP servers, and every Braintrust tool your agent needs.Free to start.

Start building