MrScraper MCP for AI Agents

Securely connect your AI agents and chatbots (Claude, ChatGPT, Cursor, etc) with MrScraper MCP or direct API to scrape websites, extract structured data, fetch search results, and collect marketplace or travel data through natural language.

MrScraper logoMrScraper
Api Key

MrScraper is a web scraping API platform for structured extraction, search results, marketplace data, travel data, and web unblocking. Use it to turn messy web pages into clean, usable data without managing scraper infrastructure.

11 Tools

Try MrScraper now

Type what you want done — sign in and watch it run live in the Tool Router playground.

TOOL ROUTER PLAYGROUND
MrScraper
Try asking
TOOLS

Supported Tools

Every MrScraper action and event your agent gets out of the box.

Bulk Rerun AI Scraper

Run an existing General AI scraper configuration against multiple URLs in one request.

Bulk Rerun Manual Scraper

Run an existing saved manual scraper workflow against multiple URLs in one request.

Create AI Scraper

Create and run a general, listing, or map AI scraper against a website.

Get Account Usage

Return the connected MrScraper account's plan, token usage, concurrency allowance, and rate limits without exposing user identity or token details.

Get Scrape Status Analytics

Return aggregate scrape counts, success rate, request rate, latency, and status totals for a domain and action over a time range.

Get Scrape Analytics Timeline

Return time-series scrape activity and success metrics for a domain and action over a time range.

Get Scrape Result

Retrieve the current status and output for one accessible scrape result by ID.

Heal Manual Scraper

Ask MrScraper to repair an existing manual scraper workflow that no longer matches its target site.

List Scrape Results

List scrape results for the connected account with filtering, sorting, and agent-controlled pagination.

Rerun AI Scraper

Run an existing AI scraper configuration against a new URL, with optional map crawl controls.

Rerun Manual Scraper

Run an existing saved manual scraper workflow against a new URL.

SETUP GUIDE

Connect MrScraper MCP Tool with your Agent

1

Install Composio

typescript
npm install @composio/core ai @ai-sdk/openai @ai-sdk/mcp
Install the Composio SDK for Python or TypeScript
2

Initialize Client and Create Tool Router Session

typescript
import { Composio } from '@composio/core';

const composio = new Composio({ apiKey: 'your-api-key' });
const session = await composio.create('your-user-id');
console.log(`Tool Router session created: ${session.mcp.url}`);
Import and initialize the Composio client, then create a Tool Router session for MrScraper
3

Connect to AI Agent

typescript
import { openai } from '@ai-sdk/openai';
import { experimental_createMCPClient as createMCPClient } from '@ai-sdk/mcp';
import { generateText } from 'ai';

const client = await createMCPClient({
  transport: {
    type: 'http',
    url: session.mcp.url,
    headers: {
      'x-api-key': 'your-composio-api-key',
    },
  },
});

const tools = await client.tools();
const { text } = await generateText({
  model: openai('gpt-4o'),
  tools,
  messages: [{
    role: 'user',
    content: 'Scrape https://books.toscrape.com/ and return book titles, prices, ratings, and URLs as structured data'
  }],
  maxSteps: 5,
});

console.log(`Agent: ${text}`);
Use the MCP server with your AI agent (Anthropic Claude or Mastra)
SETUP GUIDE

Connect MrScraper API Tool with your Agent

1

Install Composio

typescript
npm install @composio/openai
Install the Composio SDK
2

Initialize Composio and Create Tool Router Session

typescript
import OpenAI from 'openai';
import { Composio } from '@composio/core';
import { OpenAIResponsesProvider } from '@composio/openai';

const composio = new Composio({
  provider: new OpenAIResponsesProvider(),
});
const openai = new OpenAI({});
const session = await composio.create('your-user-id');
Import and initialize Composio client, then create a Tool Router session
3

Execute MrScraper Tools via Tool Router with Your Agent

typescript
const tools = session.tools;
const response = await openai.responses.create({
  model: 'gpt-4.1',
  tools: tools,
  input: [{
    role: 'user',
    content: 'Scrape structured product details and prices from https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html'
  }],
});
const result = await composio.provider.handleToolCalls(
  'your-user-id',
  response.output
);
console.log(result);
Get tools from Tool Router session and execute MrScraper actions with your Agent

Why Use Composio?

AI Native MrScraper Integration

  • Supports both MrScraper MCP and direct API based integrations
  • Structured, LLM-friendly schemas for reliable scraping and extraction tasks
  • Rich coverage for website scraping, search result collection, marketplace data, travel data, and web unblocking

Managed Auth

  • Secure API key handling so agents can use MrScraper without hard-coded secrets
  • Create API-key auth configs with auth_configs.create() and link user credentials with connected_accounts.link()
  • Per user and per environment credentials, which keeps local tests and production scrapers cleanly separated

Agent Optimized Design

  • Tools are tuned using real error and success rates to improve scraping reliability over time
  • Comprehensive execution logs so you always know which URL was scraped, when it ran, and on whose behalf
  • Clear schemas help agents return structured page data instead of messy raw HTML

Enterprise Grade Security

  • Fine-grained RBAC so you control which agents and users can access MrScraper
  • Scoped, least privilege access for scraping, search, marketplace, travel, and unblocking workflows
  • Full audit trail of agent scraping actions to support review and compliance
FAQ

Frequently asked questions

Yes, MrScraper requires you to configure your own API key. Once set up, Composio handles secure credential storage and API request handling for you.

Yes! Composio's Tool Router enables agents to use multiple toolkits. Learn more.

Composio is SOC 2 and ISO 27001 compliant with all data encrypted in transit and at rest. Learn more.

Composio maintains and updates all toolkit integrations automatically, so your agents always work with the latest API versions.

Start with MrScraper.It takes 30 seconds.

Managed auth, hosted MCP servers, and every MrScraper tool your agent needs.Free to start.

Start building