# Simplescraper MCP

```json
{
  "name": "Simplescraper MCP",
  "slug": "simplescraper_mcp",
  "url": "https://composio.dev/toolkits/simplescraper_mcp",
  "markdown_url": "https://composio.dev/toolkits/simplescraper_mcp.md",
  "logo_url": "https://logos.composio.dev/api/simplescraper_mcp",
  "categories": [
    "data & analytics"
  ],
  "is_composio_managed": false,
  "updated_at": "2026-09-07T05:31:25.886Z"
}
```

![Simplescraper MCP logo](https://logos.composio.dev/api/simplescraper_mcp)

## Description

Securely connect your AI agents and chatbots (Claude, ChatGPT, Cursor, etc) with Simplescraper MCP or direct API to create scraping recipes, run scrape jobs, fetch structured results, and manage recipes through natural language.

## Summary

Simplescraper MCP is a web scraping service that creates scraping recipes and extracts structured site data.
Use it to pull up-to-date structured web data without managing scrapers.

## Categories

- data & analytics

## Toolkit Details

- Tools: 13

## Images

- Logo: https://logos.composio.dev/api/simplescraper_mcp

## Authentication

- **Dcr Oauth**
  - Type: `custom`
  - Description: Dcr Oauth authentication for Simplescraper MCP.
  - Setup:
    - Configure Dcr Oauth credentials for Simplescraper MCP.
    - Use the credentials when creating an auth config in Composio.

## Suggested Prompts

- Create a recipe to extract product prices
- Scrape latest news headlines from example.com
- Fetch job listings from careers page

## Supported Tools

| Tool slug | Name | Description |
|---|---|---|
| `SIMPLESCRAPER_MCP_CREATE_RECIPE` | Create recipe | Create a new scrape recipe with a name, URL, and selectors. |
| `SIMPLESCRAPER_MCP_EXTRACT_MARKDOWN` | Extract markdown | Fetch one page and return its body as clean Markdown. Renders JavaScript before extraction. Returns markdown plus metadata (title, word count). |
| `SIMPLESCRAPER_MCP_EXTRACT_URLS` | Extract urls | Discover all page URLs on a website by parsing its sitemap (and the sitemap index if present). Returns a deduplicated list of page URLs. |
| `SIMPLESCRAPER_MCP_GET_LATEST_RESULTS` | Get latest results | Get the most recent scraped results for a recipe. Returns the existing data from the last completed run without scraping again. |
| `SIMPLESCRAPER_MCP_GET_RECIPE` | Get recipe | Retrieve full details of a specific scrape recipe: name, URL, creation date, last run time, and selectors. |
| `SIMPLESCRAPER_MCP_GET_RESULTS` | Get results | Fetch the scraped data from a specific run by results_id. Supports ordering (by index or timestamp) and pagination via limit and offset. |
| `SIMPLESCRAPER_MCP_GET_RESULTS_HISTORY` | Get results history | List previous scrape runs for a recipe. Each entry has results_id, scrape timestamp, and page count. Returns run metadata only, not the scraped data itself. |
| `SIMPLESCRAPER_MCP_LIST_RECIPES` | List recipes | List the user's scrape recipes, with optional filters by domain, name keyword, or recent activity, and sorting by creation date, last-run, or name. |
| `SIMPLESCRAPER_MCP_RUN_RECIPE` | Run recipe | Run a scrape recipe to extract fresh data from its configured URL. Supports async mode, source URL override, markdown extraction, and batch (crawler) mode. |
| `SIMPLESCRAPER_MCP_SCREENSHOT` | Screenshot | Capture a screenshot of a web page (1 credit per request). Returns JSON with a hosted screenshot URL by default. Supports full-page capture, custom viewport, format/quality, delays, and popup/ad hiding. Defaults output to 'url' so the response stays small; 'binary' returns raw image bytes and is not suited to an MCP text response. |
| `SIMPLESCRAPER_MCP_SMART_EXTRACT` | Smart extract | Extract specific named fields from one page using AI. Pass a comma-separated schema like 'product name, price, sku' and get those fields back as a structured object, plus the CSS selectors that matched them. |
| `SIMPLESCRAPER_MCP_UPDATE_BATCH_URLS` | Update batch urls | Add or replace the list of batch (crawler) URLs for a recipe. 'append' adds to the existing list, 'replace' overwrites it. |
| `SIMPLESCRAPER_MCP_UPDATE_RECIPE` | Update recipe | Update an existing scrape recipe's name, URL, or selectors. Supports 'replace' (default) or 'merge' modes for selector updates. |

## Supported Triggers

None listed.

## Installation and MCP Setup

### Path 1: SDK Installation

#### Path 1, Step 1: Install Composio

Install the Composio SDK
```python
pip install composio_openai
```

```typescript
npm install @composio/openai
```

#### Path 1, Step 2: Initialize Composio and Create Tool Router Session

Import and initialize Composio client, then create a Tool Router session
```python
from openai import OpenAI
from composio import Composio
from composio_openai import OpenAIResponsesProvider

composio = Composio(provider=OpenAIResponsesProvider())
openai = OpenAI()
session = composio.create(user_id='your-user-id')
```

```typescript
import OpenAI from 'openai';
import { Composio } from '@composio/core';
import { OpenAIResponsesProvider } from '@composio/openai';

const composio = new Composio({
  provider: new OpenAIResponsesProvider(),
});
const openai = new OpenAI({});
const session = await composio.create('your-user-id');
```

#### Path 1, Step 3: Execute Simplescraper MCP Tools via Tool Router with Your Agent

Get tools from Tool Router session and execute Simplescraper MCP actions with your Agent
```python
tools = session.tools
response = openai.responses.create(
  model='gpt-4.1',
  tools=tools,
  input=[{
    'role': 'user',
    'content': 'Create a scraping recipe for https://example.com/products to extract product names and prices'
  }]
)
result = composio.provider.handle_tool_calls(
  response=response,
  user_id='your-user-id'
)
print(result)
```

```typescript
const tools = session.tools;
const response = await openai.responses.create({
  model: 'gpt-4.1',
  tools: tools,
  input: [{
    role: 'user',
    content: 'Create a scraping recipe for https://example.com/products to extract product names and prices'
  }],
});
const result = await composio.provider.handleToolCalls(
  'your-user-id',
  response.output
);
console.log(result);
```

### Path 2: MCP Server Setup

#### Path 2, Step 1: Install Composio

Install the Composio SDK for Python or TypeScript
```python
pip install composio claude-agent-sdk
```

```typescript
npm install @composio/core ai @ai-sdk/openai @ai-sdk/mcp
```

#### Path 2, Step 2: Initialize Client and Create Tool Router Session

Import and initialize the Composio client, then create a Tool Router session for Simplescraper MCP
```python
from composio import Composio
from claude_agent_sdk import ClaudeSDKClient, ClaudeAgentOptions

composio = Composio(api_key='your-composio-api-key')
session = composio.create(user_id='your-user-id')
url = session.mcp.url
```

```typescript
import { Composio } from '@composio/core';

const composio = new Composio({ apiKey: 'your-api-key' });
const session = await composio.create('your-user-id');
console.log(`Tool Router session created: ${session.mcp.url}`);
```

#### Path 2, Step 3: Connect to AI Agent

Use the MCP server with your AI agent (Anthropic Claude or Mastra)
```python
import asyncio

options = ClaudeAgentOptions(
    permission_mode='bypassPermissions',
    mcp_servers={
        'tool_router': {
            'type': 'http',
            'url': url,
            'headers': {
                'x-api-key': 'your-composio-api-key'
            }
        }
    },
    system_prompt='You are a helpful assistant with access to Simplescraper MCP tools.',
    max_turns=10
)

async def main():
    async with ClaudeSDKClient(options=options) as client:
        await client.query('YOUR_SPECIFIC_PROMPT_HERE')
        async for message in client.receive_response():
            if hasattr(message, 'content'):
                for block in message.content:
                    if hasattr(block, 'text'):
                        print(block.text)

asyncio.run(main())
```

```typescript
import { openai } from '@ai-sdk/openai';
import { experimental_createMCPClient as createMCPClient } from '@ai-sdk/mcp';
import { generateText } from 'ai';

const client = await createMCPClient({
  transport: {
    type: 'http',
    url: session.mcp.url,
    headers: {
      'x-api-key': 'your-composio-api-key',
    },
  },
});

const tools = await client.tools();
const { text } = await generateText({
  model: openai('gpt-4o'),
  tools,
  messages: [{
    role: 'user',
    content: 'YOUR_SPECIFIC_PROMPT_HERE'
  }],
  maxSteps: 5,
});

console.log(`Agent: ${text}`);
```

## Why Use Composio?

### 1. AI Native Simplescraper MCP Integration

- Supports both Simplescraper MCP and direct API based integrations
- Structured, LLM-friendly schemas for reliable tool execution
- Rich coverage for reading, writing, and querying your Simplescraper MCP data

### 2. Managed Auth

- Built-in OAuth handling with automatic token refresh and rotation
- Central place to manage, scope, and revoke Simplescraper MCP access
- Per user and per environment credentials instead of hard-coded keys

### 3. Agent Optimized Design

- Tools are tuned using real error and success rates to improve reliability over time
- Comprehensive execution logs so you always know what ran, when, and on whose behalf

### 4. Enterprise Grade Security

- Fine-grained RBAC so you control which agents and users can access Simplescraper MCP
- Scoped, least privilege access to Simplescraper MCP resources
- Full audit trail of agent actions to support review and compliance

## Use Simplescraper MCP with any AI Agent Framework

Choose a framework you want to connect Simplescraper MCP with:

- [ChatGPT Work](https://composio.dev/toolkits/simplescraper_mcp/framework/chatgpt)
- [Claude Cowork](https://composio.dev/toolkits/simplescraper_mcp/framework/claude-cowork)
- [Hermes](https://composio.dev/toolkits/simplescraper_mcp/framework/hermes-agent)

## Related Toolkits

- [Excel](https://composio.dev/toolkits/excel) - Microsoft Excel is a robust spreadsheet application for organizing, analyzing, and visualizing data. It's the go-to tool for calculations, reporting, and flexible data management.
- [21risk](https://composio.dev/toolkits/_21risk) - 21RISK is a web app built for easy checklist, audit, and compliance management. It streamlines risk processes so teams can focus on what matters.
- [Abstract](https://composio.dev/toolkits/abstract) - Abstract provides a suite of APIs for automating data validation and enrichment tasks. It helps developers streamline workflows and ensure data quality with minimal effort.
- [Adafruit IO](https://composio.dev/toolkits/adafruit_io) - Adafruit IO is Adafruit's cloud platform for connected device and IoT project data. It helps you store, visualize, and act on sensor feeds without running your own backend.
- [Addressfinder](https://composio.dev/toolkits/addressfinder) - Addressfinder is a data quality platform for verifying addresses, emails, and phone numbers. It helps you ensure accurate customer and contact data every time.
- [Agentql](https://composio.dev/toolkits/agentql) - Agentql is a toolkit that connects AI agents to the web using a specialized query language. It enables structured web interaction and data extraction for smarter automations.
- [Agenty](https://composio.dev/toolkits/agenty) - Agenty is a web scraping and automation platform for extracting data and automating browser tasks—no coding needed. It streamlines data collection, monitoring, and repetitive online actions.
- [Ambee](https://composio.dev/toolkits/ambee) - Ambee is an environmental data platform providing real-time, hyperlocal APIs for air quality, weather, and pollen. Get precise environmental insights to power smarter decisions in your apps and workflows.
- [Ambient weather](https://composio.dev/toolkits/ambient_weather) - Ambient Weather is a platform for personal weather stations with a robust API for accessing local, real-time, and historical weather data. Get detailed environmental insights directly from your own sensors for smarter apps and automations.
- [Anonyflow](https://composio.dev/toolkits/anonyflow) - Anonyflow is a service for encryption-based data anonymization and secure data sharing. It helps organizations meet GDPR, CCPA, and HIPAA data privacy compliance requirements.
- [ApexVerify](https://composio.dev/toolkits/apexverify) - ApexVerify is a contact-data validation service for emails and phone numbers. Use it to normalize, verify, and clean leads before they enter your systems.
- [Api ninjas](https://composio.dev/toolkits/api_ninjas) - Api ninjas offers 120+ public APIs spanning categories like weather, finance, sports, and more. Developers use it to supercharge apps with real-time data and actionable endpoints.
- [Api sports](https://composio.dev/toolkits/api_sports) - Api sports is a comprehensive sports data platform covering 2,000+ competitions with live scores and 15+ years of stats. Instantly access up-to-date sports information for analysis, apps, or chatbots.
- [Apify](https://composio.dev/toolkits/apify) - Apify is a cloud platform for building, deploying, and managing web scraping and automation tools called Actors. It lets you automate data extraction and workflow tasks at scale—no infrastructure headaches.
- [Autom](https://composio.dev/toolkits/autom) - Autom is a lightning-fast search engine results data platform for Google, Bing, and Brave. Developers use it to access fresh, low-latency SERP data on demand.
- [Beach Day API](https://composio.dev/toolkits/beach_day_api) - Beach Day API is a beach intelligence service for search, conditions, scores, rules, amenities, tides, and country coverage. Use it to power trip planning, surf reports, safety checks, and location-aware beach discovery.
- [Beaconchain](https://composio.dev/toolkits/beaconchain) - Beaconchain is a real-time analytics platform for Ethereum 2.0's Beacon Chain. It provides detailed insights into validators, blocks, and overall network performance.
- [Big data cloud](https://composio.dev/toolkits/big_data_cloud) - BigDataCloud provides APIs for geolocation, reverse geocoding, and address validation. Instantly access reliable location intelligence to enhance your applications and workflows.
- [Bigpicture io](https://composio.dev/toolkits/bigpicture_io) - BigPicture.io offers APIs for accessing detailed company and profile data. Instantly enrich your applications with up-to-date insights on 20M+ businesses.
- [Bitquery](https://composio.dev/toolkits/bitquery) - Bitquery is a blockchain data platform offering indexed, real-time, and historical data from 40+ blockchains via GraphQL APIs. Get unified, reliable access to complex on-chain data for analytics, trading, and research.

## Frequently Asked Questions

### Do I need my own developer credentials to use Simplescraper MCP with Composio?

Yes, Simplescraper MCP requires you to configure your own Dcr Oauth credentials. Once set up, Composio handles secure credential storage and management for you.

### Can I use multiple toolkits together?

Yes! Composio's Tool Router enables agents to use multiple toolkits. [Learn more](https://docs.composio.dev/tool-router/overview).

### Is Composio secure?

Composio is SOC 2 and ISO 27001 compliant with all data encrypted in transit and at rest. [Learn more](https://trust.composio.dev).

### What if the API changes?

Composio maintains and updates all toolkit integrations automatically, so your agents always work with the latest API versions.

---
[See all toolkits](https://composio.dev/toolkits) · [Composio docs](https://docs.composio.dev/llms.txt)