Scrape do MCP for AI Agents

Securely connect your AI agents and chatbots (Claude, ChatGPT, Cursor, etc) with Scrape do MCP or direct API to extract website data, bypass anti-bot protections, manage proxy sessions, and retrieve structured results through natural language.
Trusted by
AWS
Glean
Zoom
Airtable
GET STARTED FOR FREEGET A DEMO

30 min · no commitment · see it on your stack

Scrape do Logo
Gradient Top
Gradient Middle
Gradient Bottom
divider

Try Scrape do now

Enter a prompt below to test the integration in our Tool Router playground. You'll be redirected to sign in and try it live.

Supported Tools

Tools
Cancel Async JobTool to cancel an asynchronous scraping job.
Create Async Scraping JobTool to create an asynchronous scraping job with specified targets and options.
Get Account InformationRetrieves account information and usage statistics from Scrape.
Get Amazon Product OffersGet all seller offers for any Amazon product.
Get Amazon product detailsExtract structured product data from Amazon product detail pages (PDP).
Get Amazon raw HTMLTool to get raw HTML from any Amazon page with ZIP code geo-targeting.
Get Async API Account InformationTool to get account information for the Async API including concurrency limits and usage statistics.
Get Async Job DetailsTool to retrieve details and status of a specific asynchronous scraping job.
Get Async Task ResultTool to retrieve the result of a specific task within an asynchronous job.
Scrape webpage using scrape.doA tool to scrape web pages using scrape.
List Asynchronous Scraping JobsTool to list all asynchronous scraping jobs.
Use Scrape.do Proxy ModeThis tool implements the Proxy Mode functionality of scrape.
Scrape URL using POST methodTool to scrape web pages using POST method via scrape.
Search Amazon productsTool to search Amazon and scrape product listings with structured results.
Block specific URLs during scrapingThis tool allows users to block specific URLs during the scraping process.
Set Regional Geolocation for ScrapingThis tool allows users to set a broader geographical targeting by specifying a region code instead of a specific country code.
Python
TypeScript

Install Composio

python
pip install composio claude-agent-sdk
Install the Composio SDK and Claude Agent SDK

Create Tool Router Session

python
from composio import Composio
from claude_agent_sdk import ClaudeSDKClient, ClaudeAgentOptions

composio = Composio(api_key='your-composio-api-key')
session = composio.create(user_id='your-user-id')
url = session.mcp.url
Initialize the Composio client and create a Tool Router session

Connect to AI Agent

python
import asyncio

options = ClaudeAgentOptions(
    permission_mode='bypassPermissions',
    mcp_servers={
        'tool_router': {
            'type': 'http',
            'url': url,
            'headers': {
                'x-api-key': 'your-composio-api-key'
            }
        }
    },
    system_prompt='You are a helpful assistant with access to Scrape do tools.',
    max_turns=10
)

async def main():
    async with ClaudeSDKClient(options=options) as client:
        await client.query('Scrape the HTML content of https://example.com using Scrape.do')
        async for message in client.receive_response():
            if hasattr(message, 'content'):
                for block in message.content:
                    if hasattr(block, 'text'):
                        print(block.text)

asyncio.run(main())
Use the MCP server with your AI agent

Why Use Composio?

AI Native Scrape do Integration

  • Supports both Scrape do MCP and direct API based integrations
  • Structured, LLM-friendly schemas for reliable tool execution
  • Rich coverage for reading, writing, and querying your Scrape do data

Managed Auth

  • Built-in API key management and secure storage
  • Central place to manage, scope, and revoke Scrape do access
  • Per user and per environment credentials instead of hard-coded keys

Agent Optimized Design

  • Tools are tuned using real error and success rates to improve reliability over time
  • Comprehensive execution logs so you always know what ran, when, and on whose behalf

Enterprise Grade Security

  • Fine-grained RBAC so you control which agents and users can access Scrape do
  • Scoped, least privilege access to Scrape do resources
  • Full audit trail of agent actions to support review and compliance

Use Scrape do with any AI Agent Framework

Choose a Framework you want to connect Scrape do with

Frequently Asked Questions

Do I need my own developer credentials to use Scrape do with Composio?

Yes, Scrape do requires you to configure your own API key credentials. Once set up, Composio handles secure credential storage and API request handling for you.

Can I use multiple toolkits together?

Yes! Composio's Tool Router enables agents to use multiple toolkits. Learn more.

Is Composio secure?

Composio is SOC 2 and ISO 27001 compliant with all data encrypted in transit and at rest. Learn more.

What if the API changes?

Composio maintains and updates all toolkit integrations automatically, so your agents always work with the latest API versions.

Used by agents from

Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai
Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai
Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai

Never worry about agent reliability

We handle tool reliability, observability, and security so you never have to second-guess an agent action.

Get started for freeGet a demo↗