Scrapegraph ai MCP for AI Agents

Securely connect your AI agents and chatbots (Claude, ChatGPT, Cursor, etc) with Scrapegraph ai MCP or direct API to scrape websites, extract structured tables, summarize online content, and automate data collection through natural language.
Trusted by
AWS
Glean
Zoom
Airtable
GET STARTED FOR FREEGET A DEMO

30 min · no commitment · see it on your stack

Scrapegraph ai Logo
Gradient Top
Gradient Middle
Gradient Bottom
divider

Try Scrapegraph ai now

Enter a prompt below to test the integration in our Tool Router playground. You'll be redirected to sign in and try it live.

Supported Tools

Tools
Convert Webpage to Markdown (V2)Tool to convert any webpage into clean, well-formatted Markdown with full parameter control.
Generate SchemaGenerate or modify a JSON schema based on a search query for structured data extraction.
Get Agentic Scraper HistoryRetrieve paginated history of agentic scraper jobs.
Get Crawler HistoryRetrieve the history of crawler jobs for your account.
Get CreditsRetrieve remaining and used credits for your ScrapeGraphAI account.
Get Endpoint SuggestionsTool to get AI-powered suggestions for creating scraping endpoints.
Get Live Session URLTool to get a URL for a live browser session.
Get Markdownify HistoryTool to retrieve the history of markdownify webpage-to-Markdown conversion jobs.
Get Scrape HistoryRetrieve the history of scrape jobs from your ScrapeGraphAI account.
Get Searchscraper HistoryGet the history of searchscraper jobs with pagination support.
Get Sitemap HistoryTool to retrieve the history of sitemap extraction jobs.
Get Smartscraper HistoryTool to retrieve the history of smartscraper jobs.
Get Usage TimelineTool to retrieve usage timeline statistics for your ScrapeGraphAI account.
Get Webhook LogsTool to retrieve webhook delivery logs for a crawler job.
List Scheduled JobsRetrieve a paginated list of all scheduled scraping jobs for your account.
Markdownify StatusCheck the status and retrieve results of a Markdownify webpage-to-Markdown conversion job.
Save Endpoint ConfigurationTool to save custom scraping endpoint configurations to ScrapeGraphAI.
Search ScraperPerform AI-powered web searches with structured, parsed results.
Check SearchScraper StatusCheck the status and results of an asynchronous SearchScraper job.
SmartCrawler StatusCheck the status and retrieve results of a SmartCrawler web crawling job.
Start Smart ScraperStart AI-powered web scraping with natural language extraction prompts.
SmartScraper StatusCheck the status and retrieve results of a SmartScraper web scraping job.
Start Smart Crawler (Async)Tool to start a multi-page web crawl using SmartCrawler for AI-powered data extraction.
Submit FeedbackSubmit feedback and ratings for completed ScrapeGraphAI requests.
Submit Product FeedbackSubmit product feedback for ScrapeGraphAI.
Convert JSON to TOON FormatTool to convert JSON data to TOON (Token-Oriented Object Notation) format.
Validate API KeyValidate your ScrapeGraphAI API key to ensure it is active and authorized.
Python
TypeScript

Install Composio

python
pip install composio claude-agent-sdk
Install the Composio SDK and Claude Agent SDK

Create Tool Router Session

python
from composio import Composio
from claude_agent_sdk import ClaudeSDKClient, ClaudeAgentOptions

composio = Composio(api_key='your-composio-api-key')
session = composio.create(user_id='your-user-id')
url = session.mcp.url
Initialize the Composio client and create a Tool Router session

Connect to AI Agent

python
import asyncio

options = ClaudeAgentOptions(
    permission_mode='bypassPermissions',
    mcp_servers={
        'tool_router': {
            'type': 'http',
            'url': url,
            'headers': {
                'x-api-key': 'your-composio-api-key'
            }
        }
    },
    system_prompt='You are a helpful assistant with access to Scrapegraph ai tools.',
    max_turns=10
)

async def main():
    async with ClaudeSDKClient(options=options) as client:
        await client.query('Extract all product titles from https://example.com/shop')
        async for message in client.receive_response():
            if hasattr(message, 'content'):
                for block in message.content:
                    if hasattr(block, 'text'):
                        print(block.text)

asyncio.run(main())
Use the MCP server with your AI agent

Why Use Composio?

AI Native Scrapegraph ai Integration

  • Supports both Scrapegraph ai MCP and direct API based integrations
  • Structured, LLM-friendly schemas for reliable tool execution
  • Rich coverage for reading, writing, and querying your Scrapegraph ai data

Managed Auth

  • Built-in OAuth handling with automatic token refresh and rotation
  • Central place to manage, scope, and revoke Scrapegraph ai access
  • Per user and per environment credentials instead of hard-coded keys

Agent Optimized Design

  • Tools are tuned using real error and success rates to improve reliability over time
  • Comprehensive execution logs so you always know what ran, when, and on whose behalf

Enterprise Grade Security

  • Fine-grained RBAC so you control which agents and users can access Scrapegraph ai
  • Scoped, least privilege access to Scrapegraph ai resources
  • Full audit trail of agent actions to support review and compliance

Use Scrapegraph ai with any AI Agent Framework

Choose a Framework you want to connect Scrapegraph ai with

Frequently Asked Questions

Do I need my own developer credentials to use Scrapegraph ai with Composio?

Yes, Scrapegraph ai requires you to configure your own API key credentials. Once set up, Composio handles secure credential storage and API request handling for you.

Can I use multiple toolkits together?

Yes! Composio's Tool Router enables agents to use multiple toolkits. Learn more.

Is Composio secure?

Composio is SOC 2 and ISO 27001 compliant with all data encrypted in transit and at rest. Learn more.

What if the API changes?

Composio maintains and updates all toolkit integrations automatically, so your agents always work with the latest API versions.

Used by agents from

Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai
Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai
Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai

Never worry about agent reliability

We handle tool reliability, observability, and security so you never have to second-guess an agent action.

Get started for freeGet a demo↗