How to connect Scrape do to Claude Cowork

Trusted by
AWS
Glean
Zoom
Airtable
GET STARTED FOR FREEGET A DEMO

30 min · no commitment · see it on your stack

Scrape do logo
Claude Cowork logo
divider

Introduction

Cowork is Anthropic's AI agent for knowledge work. Think of it as Claude Code for everything else. It works autonomously with your computer, local files, and applications to accomplish complex tasks.

This guide walks you through the easiest and most secure way to connect your Scrape do account to Cowork via Composio Connect, enabling it to scrape product prices from a dynamic website, extract news headlines with JavaScript rendering, bypass Cloudflare to get full page HTML, and more such actions on your behalf without compromising your account security.

Also integrate Scrape do with

Connecting Scrape do to Claude Cowork

1. Open Customize

In Claude Desktop, click Customize in the left sidebar, then select Connectors and click the + icon at the top.

Claude Desktop connectors screen with Add custom connector selected

2. Add the Composio MCP server

Click Add custom connector and paste in the Composio MCP server URL:

bash
https://connect.composio.dev/mcp
Add custom connector dialog with Composio MCP server URL

3. Authorize in your browser

Click Connect. You'll be redirected to a browser window where you can authorize Composio to continue.

Composio authorization screen for Claude Cowork

4. Connect your Scrape do account

Back in Cowork, ask the agent to connect to Scrape do or give it any Scrape do-related task.

For example, ask Cowork to:

  • "Scrape product prices from a dynamic website"
  • "Extract news headlines with JavaScript rendering"
  • "Bypass Cloudflare to get full page HTML"

It will prompt you to authenticate and authorize access.

That's it. Composio's tools are now available in Cowork, and your Scrape do account is ready to use.

What is Claude Cowork?

Claude Cowork is Anthropic's agent for general knowledge work. It can use your computer, files, and connected applications to complete longer-running tasks across your work tools.

With Composio Connect, Cowork can securely access apps like Scrape do through MCP without you sharing account credentials directly with the agent.

What is the Scrape do MCP server, and what's possible with it?

The Scrape do MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your Scrape do account. It provides structured and secure access to robust web scraping tools, so your agent can perform actions like scraping dynamic pages, managing sessions, setting custom headers or proxies, and extracting structured data from any website on your behalf.

  • Dynamic page scraping with headless browsers: Retrieve fully rendered HTML content from JavaScript-heavy or protected websites by leveraging advanced browser emulation and proxy rotation.
  • Custom scraping session management: Set device type, cookies, wait times, and custom headers to imitate different users, maintain sessions, or access device-specific content for tailored data extraction.
  • Proxy and anti-bot bypass control: Enable super or proxy modes to utilize residential, mobile, or datacenter proxies, helping your agent bypass strict anti-bot systems and geo-restrictions seamlessly.
  • Targeted resource filtering: Block specific URLs like ads or analytics scripts during scraping to increase speed, avoid distractions, and improve privacy.
  • Account usage and statistics retrieval: Access real-time usage stats, subscription status, and remaining request limits so your agent can monitor scraping quotas and avoid interruptions.

Supported Tools & Triggers

Tools
Cancel Async JobTool to cancel an asynchronous scraping job.
Create Async Scraping JobTool to create an asynchronous scraping job with specified targets and options.
Get Account InformationRetrieves account information and usage statistics from Scrape.
Get Amazon Product OffersGet all seller offers for any Amazon product.
Get Amazon product detailsExtract structured product data from Amazon product detail pages (PDP).
Get Amazon raw HTMLTool to get raw HTML from any Amazon page with ZIP code geo-targeting.
Get Async API Account InformationTool to get account information for the Async API including concurrency limits and usage statistics.
Get Async Job DetailsTool to retrieve details and status of a specific asynchronous scraping job.
Get Async Task ResultTool to retrieve the result of a specific task within an asynchronous job.
Scrape webpage using scrape.doA tool to scrape web pages using scrape.
List Asynchronous Scraping JobsTool to list all asynchronous scraping jobs.
Use Scrape.do Proxy ModeThis tool implements the Proxy Mode functionality of scrape.
Scrape URL using POST methodTool to scrape web pages using POST method via scrape.
Search Amazon productsTool to search Amazon and scrape product listings with structured results.
Block specific URLs during scrapingThis tool allows users to block specific URLs during the scraping process.
Set Regional Geolocation for ScrapingThis tool allows users to set a broader geographical targeting by specifying a region code instead of a specific country code.

How to build Scrape do MCP Agent with another framework

OpenAI Agents SDK logo

OpenAI Agents SDK

Use Scrape do MCP with OpenAI Agents SDK

Claude Agent SDK logo

Claude Agent SDK

Use Scrape do MCP with Claude Agent SDK

Claude Code logo

Claude Code

Use Scrape do MCP with Claude Code

Codex logo

Codex

Use Scrape do MCP with Codex

OpenClaw logo

OpenClaw

Use Scrape do MCP with OpenClaw

Hermes logo

Hermes

Use Scrape do MCP with Hermes

CLI logo

CLI

Use Scrape do MCP with CLI

Google ADK logo

Google ADK

Use Scrape do MCP with Google ADK

LangChain logo

LangChain

Use Scrape do MCP with LangChain

Vercel AI SDK logo

Vercel AI SDK

Use Scrape do MCP with Vercel AI SDK

Mastra AI logo

Mastra AI

Use Scrape do MCP with Mastra AI

LlamaIndex logo

LlamaIndex

Use Scrape do MCP with LlamaIndex

CrewAI logo

CrewAI

Use Scrape do MCP with CrewAI

FAQ

What are the differences in Tool Router MCP and Scrape do MCP?

With a standalone Scrape do MCP server, the agents and LLMs can only access a fixed set of Scrape do tools tied to that server. However, with the Composio Tool Router, agents can dynamically load tools from Scrape do and many other apps based on the task at hand, all through a single MCP endpoint.

Can I use Tool Router MCP with Claude Cowork?

Yes, you can. Claude Cowork fully supports MCP integration. You get structured tool calling, message history handling, and model orchestration while Tool Router takes care of discovering and serving the right Scrape do tools.

Can I manage the permissions and scopes for Scrape do while using Tool Router?

Yes, absolutely. You can configure which Scrape do scopes and actions are allowed when connecting your account to Composio. You can also bring your own OAuth credentials or API configuration so you keep full control over what the agent can do.

How safe is my data with Composio Tool Router?

All sensitive data such as tokens, keys, and configuration is fully encrypted at rest and in transit. Composio is SOC 2 Type 2 compliant and follows strict security practices so your Scrape do data and credentials are handled as safely as possible.

Used by agents from

Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai
Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai
Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai

Never worry about agent reliability

We handle tool reliability, observability, and security so you never have to second-guess an agent action.

Get started for freeGet a demo↗