How to connect Scrapingdog to Claude

Connect Claude Web, Desktop and Cowork to Scrapingdog MCP. Scrape product prices from amazon listings, search google for competitor websites, and more using natural language, with authentication handled for you.

Scrapingdog logoScrapingdog
Api Key

Scrapingdog is a web scraping API for websites, search engines, marketplaces, and social platforms. It returns structured data with proxy rotation and JavaScript rendering built in.

8 Tools

Introduction

Claude is Anthropic's AI assistant, available on the web, in the desktop app, and on mobile. Cowork is its agent for knowledge work, and it runs on all of those surfaces too. Connected to your apps, Claude can work with your files and services to accomplish complex tasks on your behalf.

This guide walks you through the easiest and most secure way to connect your Scrapingdog account to Claude via Composio Connect, enabling it to scrape product prices from Amazon listings, search Google for competitor websites, extract business details from Google Maps, and more such actions on your behalf without compromising your account security.

Setup is the same on Claude Web, Desktop, and Cowork, and you only need to do it once. The connector is tied to your account, so it's available in all three.

For exact tool slugs and parameter tables, see the tool catalog in the Composio docs.

Also integrate Scrapingdog with

Connecting Scrapingdog to Claude Web, Desktop, and Cowork

Two ways to add the Composio connector. Pick whichever you prefer.

1. Add with one click

Click the button. Claude opens with the Composio connector filled in. Click Add, then go to step 2.

Add to Claude

Add manually

In Claude Desktop, click Customize in the left sidebar, then select Connectors and click the + icon at the top.

Claude Desktop connectors screen with Add custom connector selected

Click Add custom connector and paste in the Composio MCP server URL:

bash
https://connect.composio.dev/mcp
Add custom connector dialog with Composio MCP server URL

2. Authorize in your browser

Click Connect. You'll be redirected to a browser window where you can authorize Composio to continue.

Composio authorization screen for Claude Web, Desktop, and Cowork

3. Connect your Scrapingdog account

Back in Claude, ask it to connect to Scrapingdog or give it any Scrapingdog-related task.

For example, ask Claude to:

  • "Scrape product prices from Amazon listings"
  • "Search Google for competitor websites"
  • "Extract business details from Google Maps"

It will prompt you to authenticate and authorize access.

That's it. Composio's tools are now available in Claude, and your Scrapingdog account is ready to use.

What is the Scrapingdog Claude Connector, and what's possible with it?

The Scrapingdog MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your Scrapingdog account. It provides structured and secure access to web scraping and search tools, so your agent can scrape webpages, search Google and Google Maps, find news, capture screenshots, and check API usage on your behalf.

  • Webpage data extraction: Have your agent scrape a target webpage as HTML, Markdown, a summary, links, or images.
  • Search and local business research: Let the agent run Google searches or find structured business listings through Google Maps.
  • News monitoring: Direct your agent to search Google News by topic, publication, keyword, or date and gather headlines, sources, snippets, and timestamps.
  • Webpage screenshots: Instruct your agent to capture a webpage as a PNG, JPG, or WebP image.
  • Usage tracking and form submissions: Have your agent check account usage and concurrency metrics, or send URL-encoded form data to a target webpage through Scrapingdog.

Troubleshooting

1. Why does Claude not use the Composio connector for Scrapingdog?

The connector can show as connected, but Claude must use it in each Scrapingdog conversation.

  • Click + at the lower left of the chat, or type /.
  • Hover Connectors.
  • Turn on Composio.
  • Ask Claude to connect to Scrapingdog again.

2. Why does Claude show an MCP server error before Scrapingdog connects?

Claude can show Couldn't reach the MCP server or Authorization with the MCP server failed when you add the connector for Scrapingdog.

  • Check that the connector URL is https://connect.composio.dev/mcp.
  • Connectors run from Anthropic's cloud, so your device network is usually not the problem.
  • Add the connector again from Customize > Connectors, then ask Claude to connect Scrapingdog.
  • If it fails again, send the error and the ofid_ reference id to support@composio.dev.

3. Why does the Scrapingdog authorization link not work?

The Composio connector is one server. Your Scrapingdog account connects separately when Claude asks for it.

  • If the browser does not open, or the link expires, ask Claude to retry the Scrapingdog connection.
  • Composio creates a fresh Scrapingdog authorization link.
  • Open that link in your browser and finish the Scrapingdog sign-in.

4. Why do Scrapingdog actions fail after they worked before?

The Scrapingdog connection can expire or lose permission.

  • Ask Claude to inspect the Scrapingdog connection.
  • If the connection is unhealthy, disconnect it when Claude prompts you.
  • Reconnect the Scrapingdog account and retry the action.
  • If Claude shows a permission prompt, approve it before Claude changes data in Scrapingdog.
  • If the action still fails with a permission error, check that the connected account has that permission in Scrapingdog itself.

5. How do I switch to a different Scrapingdog account?

Claude can manage the Scrapingdog connection for you.

  • Ask Claude to disconnect or delete the current Scrapingdog account.
  • Ask Claude to connect Scrapingdog again.
  • Open the new Composio authorization link for Scrapingdog.
  • Sign in with the other Scrapingdog account in the browser.
  • After the account connects, ask Claude to retry the Scrapingdog task.

6. Why is my Scrapingdog connection missing in Claude Desktop or on a Team plan?

The connector belongs to your Claude account, so your Scrapingdog connection works in Claude Web, Desktop, and Cowork.

  • In Claude Desktop, open Customize > Connectors.
  • Next to Composio, click ⋮ and click Clear cache.
  • If Scrapingdog tools still do not appear, click ⋮, disconnect, remove the connector, and add it again.
  • On Team or Enterprise, an Owner or Primary Owner must enable the connector before you can connect Scrapingdog.
TOOLS

Supported Tools

Every Scrapingdog action and event your agent gets out of the box.

Get Account Usage

Get free account usage and concurrency metrics without exposing the API key.

Google Maps Search

Search Google Maps and return structured business listings.

Google News Search

Browse Google News by topic or publication token, or run a simple keyword query with absolute dates.

Google News SERP Search

Search the Google News SERP for headlines, snippets, sources, and relative timestamps.

Google Search

Search Google and return Scrapingdog's structured result data.

Scrape URL

Scrape a URL as HTML, Markdown, a summary, links, or images.

Scrape URL with POST

Send URL-encoded form data to a target URL through Scrapingdog and return its response.

Take Screenshot

Capture a webpage screenshot as a downloadable PNG, JPG, or WebP image for 5 credits.

FAQ

Frequently asked questions

Start with Scrapingdog.It takes 30 seconds.

Managed auth, hosted MCP servers, and every Scrapingdog tool your agent needs.Free to start.

Start building