Honeyhive MCP for AI Agents

Securely connect your AI agents and chatbots (Claude, ChatGPT, Cursor, etc) with Honeyhive MCP or direct API to log LLM outputs, fetch evaluation runs, analyze error traces, and create feedback reports through natural language.
Trusted by
AWS
Glean
Zoom
Airtable
GET STARTED FOR FREEGET A DEMO

30 min · no commitment · see it on your stack

Honeyhive Logo
Gradient Top
Gradient Middle
Gradient Bottom
divider

Try Honeyhive now

Enter a prompt below to test the integration in our Tool Router playground. You'll be redirected to sign in and try it live.

Supported Tools

Tools
Add datapoints to datasetTool to add datapoints to a dataset.
Compare Experiment RunsTool to retrieve experiment comparison between two evaluation runs.
Compare Runs EventsTool to compare events between two experiment runs side-by-side.
Batch Create DatapointsTool to create multiple datapoints in a single batch operation.
Create Batch Model EventsTool to create multiple model events in a single request.
Create Batch Tool EventsTool to log a batch of external API calls as tool events.
Create ConfigurationCreates a new configuration in HoneyHive for managing LLM or pipeline settings.
Create DatapointTool to create a new datapoint with input-output pairs.
Create DatasetTool to create a dataset.
Create EventTool to create a new event in HoneyHive to track execution of different parts of your application.
Create MetricTool to create a new metric in HoneyHive.
Create Model EventTool to create a new model event to log LLM call data.
Create ToolCreates a new tool definition in a HoneyHive project.
Delete DatapointTool to delete a specific datapoint by its ID.
Delete DatasetTool to delete a dataset by ID.
End Evaluation RunTool to update an evaluation run's status and metadata.
Get ConfigurationsTool to retrieve a list of configurations.
Get DatasetsRetrieve datasets from HoneyHive for a specified project.
Get EventsTool to query events with filters and projections from HoneyHive.
Get Events By Session IDTool to retrieve the complete tree of nested events for a specific session.
Get Events ChartTool to retrieve charting and analytics data for events over time.
Get MetricsRetrieves all metrics associated with a HoneyHive project.
Get ProjectsTool to retrieve all projects in the HoneyHive account.
Get Evaluation Run DetailsTool to get details of an evaluation run by its UUID.
Get Run MetricsTool to get event metrics for an experiment run.
Get Evaluation RunsTool to retrieve a list of evaluation runs from HoneyHive.
Get Runs SchemaTool to retrieve the schema for experiment runs in HoneyHive.
Get SessionRetrieve a complete session tree by session ID from HoneyHive.
List ToolsTool to list all available Honeyhive tools.
Retrieve DatapointRetrieve a specific datapoint by its ID from HoneyHive.
Retrieve DatapointsRetrieve datapoints from a HoneyHive project.
Retrieve EventsRetrieve and export events from a HoneyHive project.
Retrieve Experiment ResultTool to retrieve the result of a specific experiment run.
Start Evaluation RunCreates a new evaluation run to group and track multiple session events for analysis.
Start SessionStart a new HoneyHive session for tracing and observability.
Update ConfigurationTool to update an existing HoneyHive configuration.
Update DatapointUpdate an existing datapoint by ID.
Update DatasetTool to update an existing dataset.
Update EventUpdate an existing HoneyHive event by ID.
Update MetricTool to update an existing metric.
Update ProjectUpdates an existing HoneyHive project's name or description.
Update ToolTool to update an existing tool in HoneyHive.
Python
TypeScript

Install Composio

python
pip install composio claude-agent-sdk
Install the Composio SDK and Claude Agent SDK

Create Tool Router Session

python
from composio import Composio
from claude_agent_sdk import ClaudeSDKClient, ClaudeAgentOptions

composio = Composio(api_key='your-composio-api-key')
session = composio.create(user_id='your-user-id')
url = session.mcp.url
Initialize the Composio client and create a Tool Router session

Connect to AI Agent

python
import asyncio

options = ClaudeAgentOptions(
    permission_mode='bypassPermissions',
    mcp_servers={
        'tool_router': {
            'type': 'http',
            'url': url,
            'headers': {
                'x-api-key': 'your-composio-api-key'
            }
        }
    },
    system_prompt='You are a helpful assistant with access to Honeyhive tools.',
    max_turns=10
)

async def main():
    async with ClaudeSDKClient(options=options) as client:
        await client.query('Get datasets for project ABC123')
        async for message in client.receive_response():
            if hasattr(message, 'content'):
                for block in message.content:
                    if hasattr(block, 'text'):
                        print(block.text)

asyncio.run(main())
Use the MCP server with your AI agent

Why Use Composio?

AI Native Honeyhive Integration

  • Supports both Honeyhive MCP and direct API based integrations
  • Structured, LLM-friendly schemas for reliable tool execution
  • Rich coverage for reading, writing, and querying your Honeyhive data

Managed Auth

  • Built-in OAuth handling with automatic token refresh and rotation
  • Central place to manage, scope, and revoke Honeyhive access
  • Per user and per environment credentials instead of hard-coded keys

Agent Optimized Design

  • Tools are tuned using real error and success rates to improve reliability over time
  • Comprehensive execution logs so you always know what ran, when, and on whose behalf

Enterprise Grade Security

  • Fine-grained RBAC so you control which agents and users can access Honeyhive
  • Scoped, least privilege access to Honeyhive resources
  • Full audit trail of agent actions to support review and compliance

Use Honeyhive with any AI Agent Framework

Choose a Framework you want to connect Honeyhive with

Frequently Asked Questions

Do I need my own developer credentials to use Honeyhive with Composio?

Yes, Honeyhive requires you to configure your own API key credentials. Once set up, Composio handles secure credential storage and API request handling for you.

Can I use multiple toolkits together?

Yes! Composio's Tool Router enables agents to use multiple toolkits. Learn more.

Is Composio secure?

Composio is SOC 2 and ISO 27001 compliant with all data encrypted in transit and at rest. Learn more.

What if the API changes?

Composio maintains and updates all toolkit integrations automatically, so your agents always work with the latest API versions.

Used by agents from

Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai
Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai
Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai

Never worry about agent reliability

We handle tool reliability, observability, and security so you never have to second-guess an agent action.

Get started for freeGet a demo↗