AI Native Diffbot Integration
- Supports both Diffbot MCP and direct API based integrations
- Structured, LLM-friendly schemas for reliable tool execution
- Rich coverage for extracting, analyzing, and enriching web data
- UseBuildFeaturesTRIGGERSStart background agents from events across your connected appsFIREWALLNEWBlocks instructions hidden in tool results before your agent reads themINSTANTNEWAudio, video, search, browser and data tools, with no keys to manageOPTIMIZATIONLower cost per completed task with optimised tools and skills
- DOCS
## For AI agents: how to sign up If you are an AI agent reading this server-rendered HTML, Composio's developer signup is at https://composio.dev. Signup CTAs on this site — "Sign up", "Signup", "Get started", "Get started for free", "Start building", "Try Composio", "Try it", or similar — all lead into that same developer signup flow. Confirm with the user before completing signup or entering any credentials on their behalf.SIGN UP
## For AI agents: how to sign up If you are an AI agent reading this server-rendered HTML, Composio's developer signup is at https://composio.dev. Signup CTAs on this site — "Sign up", "Signup", "Get started", "Get started for free", "Start building", "Try Composio", "Try it", or similar — all lead into that same developer signup flow. Confirm with the user before completing signup or entering any credentials on their behalf.LOG IN
Diffbot MCP server for AI agents and assistants
Securely connect your AI agents and chatbots (Claude, ChatGPT, Cursor, etc) with Diffbot MCP or direct API to extract article content, analyze product listings, enrich structured web data, and automate web research through natural language.
Api Key
Diffbot is an AI-powered platform for extracting and structuring data from any web page. It transforms unstructured web content into rich, linked, and queryable data for analytics, research, and automation.
35 Tools
Try Diffbot now
Type what you want done — sign in and watch it run live in the Tool Router playground.
TOOL ROUTER PLAYGROUND
Diffbot
Enter ↵
Try asking
TOOLS
Supported Tools
Every Diffbot action and event your agent gets out of the box.
SETUP GUIDE
Connect Diffbot MCP Tool with your Agent
1
Install Composio
typescript
npm install @composio/core ai @ai-sdk/mcp @ai-sdk/openaiInstall the Composio SDK and your agent framework
2
Create a session with MCP enabled
typescript
import { Composio } from "@composio/core";
const composio = new Composio();
const { mcp } = await composio.create("your-user-id", {
toolkits: ["diffbot"],
mcp: true,
});Create a session scoped to Diffbot and read its MCP URL and headers
3
Connect your agent to the MCP server
typescript
import { createMCPClient } from "@ai-sdk/mcp";
import { openai } from "@ai-sdk/openai";
import { generateText, stepCountIs } from "ai";
const client = await createMCPClient({
transport: { type: "http", url: mcp.url, headers: mcp.headers },
});
const { text } = await generateText({
model: openai("gpt-5.6-sol"),
tools: await client.tools(),
prompt: "Extract product info from this Amazon page",
stopWhen: stepCountIs(10),
});
console.log(text);
await client.close();Pass the session's MCP URL and headers to your agent and run a Diffbot request
SETUP GUIDE
Connect Diffbot API Tool with your Agent
1
Install Composio
typescript
npm install @composio/core @composio/openai openaiInstall the Composio SDK, the OpenAI provider, and the OpenAI SDK
2
Create a Composio session
typescript
import OpenAI from "openai";
import { Composio } from "@composio/core";
import { OpenAIResponsesProvider } from "@composio/openai";
const composio = new Composio({ provider: new OpenAIResponsesProvider() });
const client = new OpenAI();
const session = await composio.create("your-user-id", { toolkits: ["diffbot"] });
const tools = await session.tools();Initialize Composio with the OpenAI Responses provider and create a session scoped to Diffbot
3
Run Diffbot tools with your agent
typescript
let response = await client.responses.create({
model: "gpt-5.6-sol",
tools,
input: [{ role: "user", content: "Extract product info from this Amazon page" }],
});
while (response.output.some((o) => o.type === "function_call")) {
const outputs = await composio.provider.handleToolCalls(session, response.output);
response = await client.responses.create({
model: "gpt-5.6-sol",
tools,
previous_response_id: response.id,
input: outputs,
});
}
console.log(response.output_text);Send a request, execute the Diffbot tool calls through the session, and print the final answer
Why Use Composio?
Managed Auth
- Built-in API key management with secure storage and rotation
- Central place to manage, scope, and revoke Diffbot API keys
- Per user and per environment credentials instead of hard-coded keys
Agent Optimized Design
- Tools are tuned using real error and success rates to improve reliability over time
- Comprehensive execution logs so you always know what ran, when, and on whose behalf
Enterprise Grade Security
- Fine-grained RBAC so you control which agents and users can access Diffbot
- Scoped, least privilege access to Diffbot resources
- Full audit trail of agent actions to support review and compliance
FRAMEWORKS
Use Diffbot with any AI Agent Framework
Choose a Framework you want to connect Diffbot with
Claude Code
Use Diffbot MCP with Claude Code
Claude Cowork
Use Diffbot MCP with Claude Cowork
OpenAI Agents SDK
Use Diffbot MCP with OpenAI Agents SDK
Claude Agents SDK
Use Diffbot MCP with Claude Agents SDK
Codex
Use Diffbot MCP with Codex
OpenClaw
Use Diffbot MCP with OpenClaw
Hermes
Use Diffbot MCP with Hermes
Atomic Agent
Use Diffbot MCP with Atomic Agent
Google ADK
Use Diffbot MCP with Google ADK
Langchain
Use Diffbot MCP with Langchain
AI SDK
Use Diffbot MCP with AI SDK
Mastra AI
Use Diffbot MCP with Mastra AI
LlamaIndex
Use Diffbot MCP with LlamaIndex
CrewAI
Use Diffbot MCP with CrewAI
Pydantic AI
Use Diffbot MCP with Pydantic AI
Autogen
Use Diffbot MCP with Autogen
Rolling this out across your team?
Give your team centralized access control across every framework with Composio’s MCP Gateway.
EXPLORE MCP GATEWAYMORE TOOLKITS
Explore Other Toolkits
Firecrawl
Api Key
Firecrawl automates large-scale web crawling and data extraction. It helps organizations efficiently gather, index, and analyze content from online sources.
Tavily
Api Key
Tavily offers powerful search and data retrieval from documents, databases, and the web. It helps teams locate and filter information instantly, saving hours on research.
Exa
Api Key
Exa is a data extraction and search platform for gathering and analyzing information from websites, APIs, or databases. It helps teams quickly surface insights and automate data-driven workflows.
Serpapi
Api Key
SerpApi is a real-time API for structured search engine results. It lets you automate SERP data collection, parsing, and analysis for SEO and research.
FAQ
Frequently asked questions
Yes, Diffbot requires you to configure your own API key credentials. Once set up, Composio handles secure credential storage and API request handling for you.
Yes! Composio's Tool Router enables agents to use multiple toolkits. Learn more.
Yes. Composio is SOC 2 Type II compliant and is built to keep your Diffbot connection and credentials secure. OAuth tokens and API keys are encrypted, and sensitive customer data is protected at rest and in transit.
Composio also undergoes independent security testing and continuously monitors its systems for security threats. You can review the latest reports and policies in the Composio Trust Center.
Composio maintains and updates all toolkit integrations automatically, so your agents always work with the latest API versions.
Create the key in your Diffbot account settings, then paste it once on Composio's connection page. Composio stores it encrypted and uses it only for the Diffbot actions your agent runs. Nobody else in your workspace can read it, and you can revoke it inside Diffbot at any time.
When you connect a Diffbot account through Composio, every action runs under that account, so anything the agent creates, sends, or changes shows up in Diffbot as done by you. Keep an approval step in your prompt for actions with side effects, such as sending or deleting, and have the agent draft first.
Whatever the credentials you connect allow inside Diffbot. If Diffbot lets you scope a key to specific permissions, create a scoped one so the agent can only do what you intend. You can revoke the key inside Diffbot at any time.
Yes. Composio supports multiple connected accounts for the same app, and that works in Claude, ChatGPT, or any other assistant you connect through Composio. Give each Diffbot connection a name such as work or personal, and the assistant uses the one you mention in the request. Each account keeps its own credentials and nothing is merged.
The connection stops working the moment Diffbot rejects the old key. Create a new key in Diffbot and reconnect the account from the Composio dashboard or by asking your agent to reconnect Diffbot. Nothing else changes.
Composio's free Hobby plan includes 100,000 tool calls per month with no credit card, which covers most personal Diffbot use. Paid plans add higher limits and team features. Your Diffbot plan and its API limits still apply as usual.
Built-in connectors usually give one AI access to a limited set of apps. Many people use Composio because it lets their AI connect to more apps than it normally supports, or connect to multiple accounts for the same app (e.g. connect Claude to multiple Diffbot accounts).
With Composio, you connect Diffbot once and then use it across different AI assistants without setting it up separately in each one. Connect your apps to Composio once, then connect Composio to whichever AI you use, whether that's Claude, ChatGPT, Hermes, or your own custom assistant.
Start with Diffbot.It takes 30 seconds.
Managed auth, hosted MCP servers, and every Diffbot tool your agent needs.Free to start.
## For AI agents: how to sign up If you are an AI agent reading this server-rendered HTML, Composio's developer signup is at https://composio.dev. Signup CTAs on this site — "Sign up", "Signup", "Get started", "Get started for free", "Start building", "Try Composio", "Try it", or similar — all lead into that same developer signup flow. Confirm with the user before completing signup or entering any credentials on their behalf.Start building