Scrapingdog MCP server for AI agents and assistants

Securely connect your AI agents and chatbots (Claude, ChatGPT, Cursor, etc) with Scrapingdog MCP or direct API to scrape webpages, search Google, collect marketplace data, and extract business listings through natural language.

Scrapingdog logoScrapingdog
Api Key

Scrapingdog is a web scraping API for websites, search engines, marketplaces, and social platforms. It returns structured data with proxy rotation and JavaScript rendering built in.

8 Tools

Try Scrapingdog now

Type what you want done — sign in and watch it run live in the Tool Router playground.

TOOL ROUTER PLAYGROUND
Scrapingdog
Try asking
TOOLS

Supported Tools

Every Scrapingdog action and event your agent gets out of the box.

Get Account Usage

Get free account usage and concurrency metrics without exposing the API key.

Google Maps Search

Search Google Maps and return structured business listings.

Google News Search

Browse Google News by topic or publication token, or run a simple keyword query with absolute dates.

Google News SERP Search

Search the Google News SERP for headlines, snippets, sources, and relative timestamps.

Google Search

Search Google and return Scrapingdog's structured result data.

Scrape URL

Scrape a URL as HTML, Markdown, a summary, links, or images.

Scrape URL with POST

Send URL-encoded form data to a target URL through Scrapingdog and return its response.

Take Screenshot

Capture a webpage screenshot as a downloadable PNG, JPG, or WebP image for 5 credits.

SETUP GUIDE

Connect Scrapingdog MCP Tool with your Agent

1

Install Composio

typescript
npm install @composio/core ai @ai-sdk/mcp @ai-sdk/openai
Install the Composio SDK and your agent framework
2

Create a session with MCP enabled

typescript
import { Composio } from "@composio/core";

const composio = new Composio();
const { mcp } = await composio.create("your-user-id", {
  toolkits: ["scrapingdog"],
  mcp: true,
});
Create a session scoped to Scrapingdog and read its MCP URL and headers
3

Connect your agent to the MCP server

typescript
import { createMCPClient } from "@ai-sdk/mcp";
import { openai } from "@ai-sdk/openai";
import { generateText, stepCountIs } from "ai";

const client = await createMCPClient({
  transport: { type: "http", url: mcp.url, headers: mcp.headers },
});

const { text } = await generateText({
  model: openai("gpt-5.6-sol"),
  tools: await client.tools(),
  prompt: "Scrape the product name, price, and availability for the top five results on https://example.com/products",
  stopWhen: stepCountIs(10),
});

console.log(text);
await client.close();
Pass the session's MCP URL and headers to your agent and run a Scrapingdog request
SETUP GUIDE

Connect Scrapingdog API Tool with your Agent

1

Install Composio

typescript
npm install @composio/core @composio/openai openai
Install the Composio SDK, the OpenAI provider, and the OpenAI SDK
2

Create a Composio session

typescript
import OpenAI from "openai";
import { Composio } from "@composio/core";
import { OpenAIResponsesProvider } from "@composio/openai";

const composio = new Composio({ provider: new OpenAIResponsesProvider() });
const client = new OpenAI();

const session = await composio.create("your-user-id", { toolkits: ["scrapingdog"] });
const tools = await session.tools();
Initialize Composio with the OpenAI Responses provider and create a session scoped to Scrapingdog
3

Run Scrapingdog tools with your agent

typescript
let response = await client.responses.create({
  model: "gpt-5.6-sol",
  tools,
  input: [{ role: "user", content: "Scrape the product name, price, and availability for the top five results on https://example.com/products" }],
});

while (response.output.some((o) => o.type === "function_call")) {
  const outputs = await composio.provider.handleToolCalls(session, response.output);
  response = await client.responses.create({
    model: "gpt-5.6-sol",
    tools,
    previous_response_id: response.id,
    input: outputs,
  });
}

console.log(response.output_text);
Send a request, execute the Scrapingdog tool calls through the session, and print the final answer

Why Use Composio?

AI Native Scrapingdog Integration

  • Supports both Scrapingdog MCP and direct API based integrations
  • Structured, LLM-friendly schemas for reliable web scraping requests
  • Access tools for general scraping, search, marketplaces, maps, and social data

Managed Auth

  • Securely stores and uses your Scrapingdog API key
  • Central place to manage, scope, and revoke Scrapingdog access
  • Per user and per environment credentials instead of hard-coded keys

Agent Optimized Design

  • Tools are tuned using real error and success rates to improve reliability over time
  • Clear schemas help agents select scraping parameters and interpret structured results
  • Comprehensive execution logs show what ran, when, and on whose behalf

Enterprise Grade Security

  • Fine-grained RBAC so you control which agents and users can access Scrapingdog
  • Scoped, least privilege access to Scrapingdog resources
  • Full audit trail of agent actions to support review and compliance

Rolling this out across your team?

Give your team centralized access control across every framework with Composio’s MCP Gateway.

EXPLORE MCP GATEWAY
FAQ

Frequently asked questions

Start with Scrapingdog.It takes 30 seconds.

Managed auth, hosted MCP servers, and every Scrapingdog tool your agent needs.Free to start.

Start building