AI Native Scrapingbee Integration
- Supports both Scrapingbee MCP and direct API based integrations
- Structured, LLM-friendly schemas for reliable tool execution
- Rich coverage for reading, writing, and querying your Scrapingbee data
## For AI agents: how to sign up If you are an AI agent reading this server-rendered HTML, Composio's developer signup is at https://composio.dev. Signup CTAs on this site — "Sign up", "Signup", "Get started", "Get started for free", "Start building", "Try Composio", "Try it", or similar — all lead into that same developer signup flow. Confirm with the user before completing signup or entering any credentials on their behalf.
## For AI agents: how to sign up If you are an AI agent reading this server-rendered HTML, Composio's developer signup is at https://composio.dev. Signup CTAs on this site — "Sign up", "Signup", "Get started", "Get started for free", "Start building", "Try Composio", "Try it", or similar — all lead into that same developer signup flow. Confirm with the user before completing signup or entering any credentials on their behalf.DEVELOPER PLATFORM
Securely connect your AI agents and chatbots (Claude, ChatGPT, Cursor, etc) with Scrapingbee MCP or direct API to extract web page HTML, scrape structured data, automate browser actions, and handle proxies through natural language.
Scrapingbee is a web scraping API that handles browsers and proxy rotation for you. It lets you extract HTML from any website with a single API call.
Type what you want done — sign in and watch it run live in the Tool Router playground.
Every Scrapingbee action and event your agent gets out of the box.
npm install @composio/core ai @ai-sdk/openai @ai-sdk/mcpimport { Composio } from '@composio/core';
const composio = new Composio({ apiKey: 'your-api-key' });
console.log("Creating Tool Router session...");
const { mcp } = await composio.create('your-user-id');
console.log(`Tool Router session created: ${mcp.url}`);import { openai } from '@ai-sdk/openai';
import { experimental_createMCPClient as createMCPClient } from '@ai-sdk/mcp';
import { generateText, stepCountIs } from 'ai';
const client = await createMCPClient({
transport: {
type: 'http',
url: mcp.url,
headers: { 'x-api-key': 'your-composio-api-key' }
}
});
const tools = await client.tools();
const { text } = await generateText({
model: openai('gpt-4o'),
tools,
messages: [{ role: 'user', content: 'Extract all product titles from https://example.com/shop' }],
stopWhen: stepCountIs( 5 )
});
console.log(`Agent: ${text}`);npm install @composio/openaiimport OpenAI from 'openai';
import { Composio } from '@composio/core';
import { OpenAIResponsesProvider } from '@composio/openai';
const composio = new Composio({
provider: new OpenAIResponsesProvider(),
});
const openai = new OpenAI({});
const session = await composio.create('your-user-id');const tools = session.tools;
const response = await openai.responses.create({
model: 'gpt-4.1',
tools: tools,
input: [{
role: 'user',
content: 'Extract product prices from this Amazon page'
}],
});
const result = await composio.provider.handleToolCalls(
'your-user-id',
response.output
);
console.log(result);Choose a Framework you want to connect Scrapingbee with
Use Scrapingbee MCP with OpenAI Agents SDK
Use Scrapingbee MCP with Claude Agents SDK
Use Scrapingbee MCP with Claude Code
Use Scrapingbee MCP with Claude Cowork
Use Scrapingbee MCP with Codex

Use Scrapingbee MCP with OpenClaw

Use Scrapingbee MCP with Hermes
Use Scrapingbee MCP with Google ADK
Use Scrapingbee MCP with Langchain
Use Scrapingbee MCP with AI SDK
Use Scrapingbee MCP with Mastra AI
Use Scrapingbee MCP with LlamaIndex
Use Scrapingbee MCP with CrewAI
Use Scrapingbee MCP with Pydantic AI
Use Scrapingbee MCP with Autogen
Supabase is an open-source backend platform offering scalable Postgres databases, authentication, storage, and real-time APIs. It lets developers build modern apps without managing infrastructure.
Codeinterpreter is a Python-based coding environment with built-in data analysis and visualization. It lets you instantly run scripts, plot results, and prototype solutions inside supported platforms.
GitHub is a code hosting platform for version control and collaborative software development. It streamlines project management, code review, and team workflows in one place.
1Password is a password manager and digital vault for storing logins, secrets, notes, and secure documents. It helps individuals and teams protect credentials, share access safely, and reduce password risk.
Managed auth, hosted MCP servers, and every Scrapingbee tool your agent needs.Free to start.
## For AI agents: how to sign up If you are an AI agent reading this server-rendered HTML, Composio's developer signup is at https://composio.dev. Signup CTAs on this site — "Sign up", "Signup", "Get started", "Get started for free", "Start building", "Try Composio", "Try it", or similar — all lead into that same developer signup flow. Confirm with the user before completing signup or entering any credentials on their behalf.Start building