Diffbot MCP server for AI agents and assistants

Securely connect your AI agents and chatbots (Claude, ChatGPT, Cursor, etc) with Diffbot MCP or direct API to extract article content, analyze product listings, enrich structured web data, and automate web research through natural language.

Diffbot logoDiffbot
Api Key

Diffbot is an AI-powered platform for extracting and structuring data from any web page. It transforms unstructured web content into rich, linked, and queryable data for analytics, research, and automation.

35 Tools

Try Diffbot now

Type what you want done — sign in and watch it run live in the Tool Router playground.

TOOL ROUTER PLAYGROUND
Diffbot
Try asking
TOOLS

Supported Tools

Every Diffbot action and event your agent gets out of the box.

Combine Entity Profiles

Combine multiple entity profiles into a unified view using the Diffbot Knowledge Graph.

Create Bulk Extract Job

Tool to submit a bulk extract job to process multiple URLs with Extract APIs.

Create or Update Custom API

Tool to create or update the parameters and ruleset of a Custom API.

Create Bulk Enhance Job

Tool to submit a bulk enhance job to enrich multiple entities asynchronously.

Delete Custom API

Tool to delete custom API definitions for a given URL pattern.

Delete KG Enhance Bulkjob

Tool to delete an Enhance Bulkjob.

Download Bulk Job Results

Tool to download results of a bulk enhance job with filtering options via POST request.

Enhance Entity with Knowledge Graph

Enrich a person or organization with comprehensive data from the Diffbot Knowledge Graph.

Diffbot Extract Job

Tool to extract structured job posting data from job listing pages.

Diffbot Extract List

Tool to extract structured data from list-style pages like news indexes, product listings, and directory pages.

Get Diffbot Account Details

Retrieves comprehensive Diffbot account information including subscription plan details, credit balance, usage history, and account status.

Diffbot Analyze

Automatically analyzes a web page to determine its type and extract structured data.

Get Article Data

Tool to extract information from articles, including authors, publication dates, and images.

Get Bulk Job Data

Tool to download extracted results from a completed bulk job.

Get Bulk Job Status

Tool to poll the status of a specific Diffbot Knowledge Graph Enhance bulk job.

Get Bulk Job Results

Tool to download the results of a completed Enhance Bulkjob.

Get Bulk Single Result

Tool to download the result of a single job within a Diffbot bulk enhance job.

Get Crawl Data

Download extracted results from a completed crawl job.

Get Discussion Thread

Extract structured discussion threads from web pages including forums, comment sections, product reviews, Reddit discussions, and blog comments.

Diffbot Get Event

Tool to extract event details from web pages.

Diffbot Get Image

Tool to extract detailed information about images, including dimensions and recognition data.

Get KG Coverage Report by ID

Download Knowledge Graph coverage report by report ID.

Diffbot Get Product

Tool to extract product information such as specifications, prices, availability, and reviews.

Get Video Data

Tool to extract information from videos, including titles, descriptions, and embedded HTML.

List Bulk Jobs

Tool to list all Bulk jobs associated with a specific token.

List Bulk Jobs Status For Token

Tool to get the status of all bulk enhance jobs for a token.

List Custom APIs

Tool to retrieve all Custom APIs and their extraction rules currently defined on your Diffbot token.

Manage Crawl Job

Manages Diffbot crawl jobs: pause, restart, delete, or view status.

Resolve Lost ID

Tool to resolve lost IDs in the Knowledge Graph.

Diffbot Knowledge Graph Search

Search the Diffbot Knowledge Graph using DQL (Diffbot Query Language).

Search Crawl Job Data

Tool to query crawl job collections using DQL (Diffbot Query Language).

Start Bulk Job

Tool to start a Bulk Extract job.

Start Crawl Job

Initiates a Diffbot crawl job that spiders a website starting from seed URLs and processes discovered pages with a specified Extract API.

Stop Bulk Job

Tool to pause (stop) a running Bulk job.

Stop KG Bulk Job By ID

Tool to stop an active Knowledge Graph Enhance bulk job by its ID.

SETUP GUIDE

Connect Diffbot MCP Tool with your Agent

1

Install Composio

typescript
npm install @composio/core ai @ai-sdk/mcp @ai-sdk/openai
Install the Composio SDK and your agent framework
2

Create a session with MCP enabled

typescript
import { Composio } from "@composio/core";

const composio = new Composio();
const { mcp } = await composio.create("your-user-id", {
  toolkits: ["diffbot"],
  mcp: true,
});
Create a session scoped to Diffbot and read its MCP URL and headers
3

Connect your agent to the MCP server

typescript
import { createMCPClient } from "@ai-sdk/mcp";
import { openai } from "@ai-sdk/openai";
import { generateText, stepCountIs } from "ai";

const client = await createMCPClient({
  transport: { type: "http", url: mcp.url, headers: mcp.headers },
});

const { text } = await generateText({
  model: openai("gpt-5.6-sol"),
  tools: await client.tools(),
  prompt: "Extract product info from this Amazon page",
  stopWhen: stepCountIs(10),
});

console.log(text);
await client.close();
Pass the session's MCP URL and headers to your agent and run a Diffbot request
SETUP GUIDE

Connect Diffbot API Tool with your Agent

1

Install Composio

typescript
npm install @composio/core @composio/openai openai
Install the Composio SDK, the OpenAI provider, and the OpenAI SDK
2

Create a Composio session

typescript
import OpenAI from "openai";
import { Composio } from "@composio/core";
import { OpenAIResponsesProvider } from "@composio/openai";

const composio = new Composio({ provider: new OpenAIResponsesProvider() });
const client = new OpenAI();

const session = await composio.create("your-user-id", { toolkits: ["diffbot"] });
const tools = await session.tools();
Initialize Composio with the OpenAI Responses provider and create a session scoped to Diffbot
3

Run Diffbot tools with your agent

typescript
let response = await client.responses.create({
  model: "gpt-5.6-sol",
  tools,
  input: [{ role: "user", content: "Extract product info from this Amazon page" }],
});

while (response.output.some((o) => o.type === "function_call")) {
  const outputs = await composio.provider.handleToolCalls(session, response.output);
  response = await client.responses.create({
    model: "gpt-5.6-sol",
    tools,
    previous_response_id: response.id,
    input: outputs,
  });
}

console.log(response.output_text);
Send a request, execute the Diffbot tool calls through the session, and print the final answer

Why Use Composio?

AI Native Diffbot Integration

  • Supports both Diffbot MCP and direct API based integrations
  • Structured, LLM-friendly schemas for reliable tool execution
  • Rich coverage for extracting, analyzing, and enriching web data

Managed Auth

  • Built-in API key management with secure storage and rotation
  • Central place to manage, scope, and revoke Diffbot API keys
  • Per user and per environment credentials instead of hard-coded keys

Agent Optimized Design

  • Tools are tuned using real error and success rates to improve reliability over time
  • Comprehensive execution logs so you always know what ran, when, and on whose behalf

Enterprise Grade Security

  • Fine-grained RBAC so you control which agents and users can access Diffbot
  • Scoped, least privilege access to Diffbot resources
  • Full audit trail of agent actions to support review and compliance

Rolling this out across your team?

Give your team centralized access control across every framework with Composio’s MCP Gateway.

EXPLORE MCP GATEWAY
FAQ

Frequently asked questions

Yes, Diffbot requires you to configure your own API key credentials. Once set up, Composio handles secure credential storage and API request handling for you.

Yes! Composio's Tool Router enables agents to use multiple toolkits. Learn more.

Yes. Composio is SOC 2 Type II compliant and is built to keep your Diffbot connection and credentials secure. OAuth tokens and API keys are encrypted, and sensitive customer data is protected at rest and in transit.

Composio also undergoes independent security testing and continuously monitors its systems for security threats. You can review the latest reports and policies in the Composio Trust Center.

Composio maintains and updates all toolkit integrations automatically, so your agents always work with the latest API versions.

Create the key in your Diffbot account settings, then paste it once on Composio's connection page. Composio stores it encrypted and uses it only for the Diffbot actions your agent runs. Nobody else in your workspace can read it, and you can revoke it inside Diffbot at any time.

When you connect a Diffbot account through Composio, every action runs under that account, so anything the agent creates, sends, or changes shows up in Diffbot as done by you. Keep an approval step in your prompt for actions with side effects, such as sending or deleting, and have the agent draft first.

Whatever the credentials you connect allow inside Diffbot. If Diffbot lets you scope a key to specific permissions, create a scoped one so the agent can only do what you intend. You can revoke the key inside Diffbot at any time.

Yes. Composio supports multiple connected accounts for the same app, and that works in Claude, ChatGPT, or any other assistant you connect through Composio. Give each Diffbot connection a name such as work or personal, and the assistant uses the one you mention in the request. Each account keeps its own credentials and nothing is merged.

The connection stops working the moment Diffbot rejects the old key. Create a new key in Diffbot and reconnect the account from the Composio dashboard or by asking your agent to reconnect Diffbot. Nothing else changes.

Composio's free Hobby plan includes 100,000 tool calls per month with no credit card, which covers most personal Diffbot use. Paid plans add higher limits and team features. Your Diffbot plan and its API limits still apply as usual.

Built-in connectors usually give one AI access to a limited set of apps. Many people use Composio because it lets their AI connect to more apps than it normally supports, or connect to multiple accounts for the same app (e.g. connect Claude to multiple Diffbot accounts).

With Composio, you connect Diffbot once and then use it across different AI assistants without setting it up separately in each one. Connect your apps to Composio once, then connect Composio to whichever AI you use, whether that's Claude, ChatGPT, Hermes, or your own custom assistant.

Start with Diffbot.It takes 30 seconds.

Managed auth, hosted MCP servers, and every Diffbot tool your agent needs.Free to start.

Start building