How to connect Scrapfly to Claude Cowork

Cowork is Anthropic's AI agent for knowledge work. Think of it as Claude Code for everything else. It works autonomously with your computer, local files, and applications to accomplish complex tasks.

This guide walks you through the easiest and most secure way to connect your Scrapfly account to Cowork via Composio Connect, enabling it to extract product prices from Amazon listings, scrape job postings from LinkedIn search, get latest news headlines from BBC homepage, and more such actions on your behalf without compromising your account security.

Connecting Scrapfly to Claude Cowork

1. Open Customize

In Claude Desktop, click Customize in the left sidebar, then select Connectors and click the + icon at the top.

2. Add the Composio MCP server

Click Add custom connector and paste in the Composio MCP server URL:

Claude Cowork is Anthropic's agent for general knowledge work. It can use your computer, files, and connected applications to complete longer-running tasks across your work tools.

With Composio Connect, Cowork can securely access apps like Scrapfly through MCP without you sharing account credentials directly with the agent.

The Scrapfly MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your Scrapfly account. It provides structured and secure access to powerful web scraping capabilities, so your agent can perform actions like extracting website data, bypassing anti-bot protection, rendering JavaScript content, and rotating proxies—all on your behalf.

• Dynamic web data extraction: Instruct your agent to fetch and extract content from almost any website, even those with heavy client-side rendering or complex structures.
• JavaScript rendering support: Enable your agent to scrape websites that require full JavaScript execution for content loading, making dynamic sites accessible for data extraction.
• Anti-bot protection bypass: Allow your agent to automatically navigate sites with CAPTCHAs, bot detection, or rate limiting using Scrapfly's built-in countermeasures.
• Automatic proxy rotation: Let your agent leverage Scrapfly's proxy network to rotate requests, reduce blocks, and ensure more reliable scraping at scale.
• Custom request handling: Have your agent specify advanced options like custom headers or cookies for targeted and flexible scraping sessions.