# Parse.bot

```json
{
  "name": "Parse.bot",
  "slug": "parse_bot",
  "url": "https://composio.dev/toolkits/parse_bot",
  "markdown_url": "https://composio.dev/toolkits/parse_bot.md",
  "logo_url": "https://logos.composio.dev/api/parse_bot",
  "categories": [
    "developer tools & devops"
  ],
  "is_composio_managed": false,
  "updated_at": "2026-11-17T05:43:13.899Z"
}
```

![Parse.bot logo](https://logos.composio.dev/api/parse_bot)

## Description

Securely connect your AI agents and chatbots (Claude, ChatGPT, Cursor, etc) with Parse.bot MCP or direct API to create scraping APIs, extract website data, manage scraping endpoints, and run targeted web queries through natural language.

## Summary

Parse.bot creates and runs site-specific scraping APIs from website URLs.
It turns web pages into structured data through reusable, targeted APIs.

## Categories

- developer tools & devops

## Toolkit Details

- Tools: 22

## Images

- Logo: https://logos.composio.dev/api/parse_bot

## Authentication

- **Api Key**
  - Type: `api_key`
  - Description: Api Key authentication for Parse.bot.
  - Setup:
    - Configure Api Key credentials for Parse.bot.
    - Use the credentials when creating an auth config in Composio.

## Suggested Prompts

- Create scraping API for product pricing pages
- Extract job listings from company career pages
- Run scraper on latest technology news stories

## Supported Tools

| Tool slug | Name | Description |
|---|---|---|
| `PARSE_BOT_CANCEL_API_BUILD_TASK` | Cancel API Build Task | Irreversibly cancel an in-flight API build or revision task; terminal tasks cannot be cancelled. |
| `PARSE_BOT_CHECK_API_UPDATES` | Check API Updates | List new or changed canonical endpoints available to merge into a linked generated API without modifying it. |
| `PARSE_BOT_CREATE_API_FROM_URL` | Create API from URL | Start a persistent task that builds a callable API from a website URL; private builds and authenticated-site builds may require a paid plan or incur charges. |
| `PARSE_BOT_EXECUTE_GENERATED_GET_ENDPOINT` | Execute Generated GET Endpoint | Execute one generated GET endpoint with its schema-defined query parameters. Each call consumes the endpoint's advertised Parse.bot credits and may access an external site. Login and authenticated-session endpoints are intentionally unsupported because their credentials must stay out of model context; inspect the generated OpenAPI document or MCP export first. |
| `PARSE_BOT_EXECUTE_GENERATED_POST_ENDPOINT` | Execute Generated POST Endpoint | Execute one generated POST endpoint with its schema-defined JSON parameters. Each call consumes the endpoint's advertised Parse.bot credits and may cause endpoint-specific external effects. Login and authenticated-session endpoints are intentionally unsupported because their credentials must stay out of model context; inspect the generated OpenAPI document or MCP export before calling. |
| `PARSE_BOT_EXPORT_API_AS_MCP_TOOLS` | Export API as MCP Tools | Export a completed generated API as MCP tool definitions, preserving each tool's dynamic input schema, execution metadata, and provider-reported price. |
| `PARSE_BOT_FORK_MARKETPLACE_API` | Fork Marketplace API | Create a persistent private copy of a marketplace API. The copy is permanently desynchronized from the canonical API, may require a paid tier or incur charges, and cannot be deleted through the documented API. |
| `PARSE_BOT_GET_ACTIVE_SCRAPER_TASK` | Get Active Scraper Task | Get the active revision or extension task for a generated Parse.bot scraper, returning null when none is in flight. |
| `PARSE_BOT_GET_API_BUILD_TASK` | Get API Build Task | Get full details, progress, prompts, errors, and the generated API specification for one Parse.bot build or revision task. |
| `PARSE_BOT_GET_API_OPENAPI_DOCUMENT` | Get API OpenAPI Document | Return the complete OpenAPI 3.1 document for a callable generated API, optionally pinned to an available snapshot version. |
| `PARSE_BOT_GET_API_SDK_EXAMPLE` | Get API SDK Example | Get Parse SDK example code and endpoint names for a completed generated API, or null when no example is available. |
| `PARSE_BOT_GET_MARKETPLACE_API` | Get Marketplace API | Get a public marketplace API listing with its callable endpoint schemas, prices, versions, authentication requirements, and current subscription state. |
| `PARSE_BOT_LIST_API_BUILD_TASKS` | List API Build Tasks | Return one page of API build and revision tasks for the connected Parse.bot account, optionally filtered by status. |
| `PARSE_BOT_LIST_API_REVISIONS` | List API Revisions | List all revision child tasks for a Parse.bot API build task, including exact-total metadata when provided. |
| `PARSE_BOT_MERGE_API_UPDATES` | Merge API Updates | Merge selected canonical endpoint updates into an existing generated API, persistently changing its callable endpoint set or code. |
| `PARSE_BOT_PREVIEW_API_ENDPOINT_UPDATE` | Preview API Endpoint Update | Execute a pending canonical endpoint update as a preview without merging it. The preview invokes an endpoint with dynamically unknown effects, may change external or session state, and may consume Parse.bot credits or incur charges. |
| `PARSE_BOT_RESPOND_TO_API_BUILD_PROMPT` | Respond to API Build Prompt | Submit a pre-encrypted response to an API build task waiting for user input. The AES-GCM/RSA-OAEP envelope must be created outside model context from the task prompt's public key; never provide plaintext credentials or 2FA values. |
| `PARSE_BOT_REVISE_API` | Revise API | Start a persistent revision task for a completed API. By default the API remains linked to the shared marketplace canonical and the revision is free; choosing a private revision permanently desynchronizes it and incurs charges. |
| `PARSE_BOT_ROLLBACK_API_UPDATE_MERGE` | Rollback API Update Merge | Irreversibly restore a generated API to its state before its most recent canonical update merge. Only the latest merge can be rolled back. |
| `PARSE_BOT_SEARCH_MARKETPLACE_APIS` | Search Marketplace APIs | Return one page of public Parse.bot marketplace APIs filtered by text, category, country, and sort order. |
| `PARSE_BOT_SEARCH_MARKETPLACE_ENDPOINTS` | Search Marketplace Endpoints | Search individual callable endpoints across public marketplace APIs and return matching API and endpoint groups. |
| `PARSE_BOT_SUBSCRIBE_TO_MARKETPLACE_API` | Subscribe to Marketplace API | Create a persistent, pinned, sync-eligible copy of a public marketplace API in the connected account. Parse.bot provides no documented unsubscribe or delete endpoint for removing the created copy. |

## Supported Triggers

None listed.

## Installation and MCP Setup

### Path 1: SDK Installation

#### Path 1, Step 1: Install Composio

Install the Composio SDK, the OpenAI provider, and the OpenAI SDK
```python
pip install composio composio_openai openai
```

```typescript
npm install @composio/core @composio/openai openai
```

#### Path 1, Step 2: Create a Composio session

Initialize Composio with the OpenAI Responses provider and create a session scoped to Parse.bot
```python
import json
from openai import OpenAI
from composio import Composio
from composio_openai import OpenAIResponsesProvider

composio = Composio(provider=OpenAIResponsesProvider())
client = OpenAI()

session = composio.create(user_id="your-user-id", toolkits=["parse_bot"])
tools = session.tools()
```

```typescript
import OpenAI from "openai";
import { Composio } from "@composio/core";
import { OpenAIResponsesProvider } from "@composio/openai";

const composio = new Composio({ provider: new OpenAIResponsesProvider() });
const client = new OpenAI();

const session = await composio.create("your-user-id", { toolkits: ["parse_bot"] });
const tools = await session.tools();
```

#### Path 1, Step 3: Run Parse.bot tools with your agent

Send a request, execute the Parse.bot tool calls through the session, and print the final answer
```python
response = client.responses.create(
    model="gpt-5.6-sol",
    tools=tools,
    input=[{"role": "user", "content": "Create a Parse.bot scraping API for https://news.ycombinator.com and extract the titles, links, and scores of the 10 newest stories."}],
)

while True:
    tool_calls = [o for o in response.output if o.type == "function_call"]
    if not tool_calls:
        break
    results = composio.provider.handle_tool_calls(response=response, session=session)
    response = client.responses.create(
        model="gpt-5.6-sol",
        tools=tools,
        previous_response_id=response.id,
        input=[
            {"type": "function_call_output", "call_id": call.call_id, "output": json.dumps(results[i])}
            for i, call in enumerate(tool_calls)
        ],
    )

print(response.output_text)
```

```typescript
let response = await client.responses.create({
  model: "gpt-5.6-sol",
  tools,
  input: [{ role: "user", content: "Create a Parse.bot scraping API for https://news.ycombinator.com and extract the titles, links, and scores of the 10 newest stories." }],
});

while (response.output.some((o) => o.type === "function_call")) {
  const outputs = await composio.provider.handleToolCalls(session, response.output);
  response = await client.responses.create({
    model: "gpt-5.6-sol",
    tools,
    previous_response_id: response.id,
    input: outputs,
  });
}

console.log(response.output_text);
```

### Path 2: MCP Server Setup

#### Path 2, Step 1: Install Composio

Install the Composio SDK and your agent framework
```python
pip install composio claude-agent-sdk
```

```typescript
npm install @composio/core ai @ai-sdk/mcp @ai-sdk/openai
```

#### Path 2, Step 2: Create a session with MCP enabled

Create a session scoped to Parse.bot and read its MCP URL and headers
```python
from composio import Composio

composio = Composio()
session = composio.create(user_id="your-user-id", toolkits=["parse_bot"], mcp=True)
```

```typescript
import { Composio } from "@composio/core";

const composio = new Composio();
const { mcp } = await composio.create("your-user-id", {
  toolkits: ["parse_bot"],
  mcp: true,
});
```

#### Path 2, Step 3: Connect your agent to the MCP server

Pass the session's MCP URL and headers to your agent and run a Parse.bot request
```python
import asyncio
from claude_agent_sdk import ClaudeSDKClient, ClaudeAgentOptions, AssistantMessage, TextBlock

options = ClaudeAgentOptions(
    mcp_servers={
        "composio": {
            "type": "http",
            "url": session.mcp.url,
            "headers": session.mcp.headers,
        }
    },
    system_prompt="You are a helpful assistant with access to Parse.bot tools.",
    tools=[],
    allowed_tools=["mcp__composio__*"],
)

async def main():
    async with ClaudeSDKClient(options=options) as client:
        await client.query("Create a Parse.bot scraping API for https://news.ycombinator.com and extract the titles, links, and scores of the 10 newest stories.")
        async for message in client.receive_response():
            if isinstance(message, AssistantMessage):
                for block in message.content:
                    if isinstance(block, TextBlock):
                        print(block.text)

asyncio.run(main())
```

```typescript
import { createMCPClient } from "@ai-sdk/mcp";
import { openai } from "@ai-sdk/openai";
import { generateText, stepCountIs } from "ai";

const client = await createMCPClient({
  transport: { type: "http", url: mcp.url, headers: mcp.headers },
});

const { text } = await generateText({
  model: openai("gpt-5.6-sol"),
  tools: await client.tools(),
  prompt: "Create a Parse.bot scraping API for https://news.ycombinator.com and extract the titles, links, and scores of the 10 newest stories.",
  stopWhen: stepCountIs(10),
});

console.log(text);
await client.close();
```

## Why Use Composio?

### 1. AI Native Parse.bot Integration

- Supports both Parse.bot MCP and direct API based integrations
- Structured, LLM-friendly schemas for reliable scraping API execution
- Rich coverage for creating, managing, and running Parse.bot scraping APIs

### 2. Secure API Key Handling

- Connect Parse.bot with your own API key without hard-coding credentials
- Central place to manage, scope, and revoke Parse.bot access
- Per user and per environment credentials for safer deployments

### 3. Agent Optimized Design

- Tools are tuned using real error and success rates to improve reliability over time
- Comprehensive execution logs so you always know what ran, when, and on whose behalf

### 4. Enterprise Grade Security

- Fine-grained RBAC so you control which agents and users can access Parse.bot
- Scoped, least privilege access to Parse.bot resources
- Full audit trail of agent actions to support review and compliance

## Use Parse.bot with any AI Agent Framework

Choose a framework you want to connect Parse.bot with:

- [ChatGPT](https://composio.dev/toolkits/parse_bot/framework/chatgpt)
- [Claude Cowork](https://composio.dev/toolkits/parse_bot/framework/claude-cowork)
- [Hermes](https://composio.dev/toolkits/parse_bot/framework/hermes-agent)
- [Atomic Agent](https://composio.dev/toolkits/parse_bot/framework/atomic-agent)

## Related Toolkits

- [Supabase](https://composio.dev/toolkits/supabase) - Supabase is an open-source backend platform offering scalable Postgres databases, authentication, storage, and real-time APIs. It lets developers build modern apps without managing infrastructure.
- [Codeinterpreter](https://composio.dev/toolkits/codeinterpreter) - Codeinterpreter is a Python-based coding environment with built-in data analysis and visualization. It lets you instantly run scripts, plot results, and prototype solutions inside supported platforms.
- [GitHub](https://composio.dev/toolkits/github) - GitHub is a code hosting platform for version control and collaborative software development. It streamlines project management, code review, and team workflows in one place.
- [1password](https://composio.dev/toolkits/_1password) - 1Password is a password manager and digital vault for storing logins, secrets, notes, and secure documents. It helps individuals and teams protect credentials, share access safely, and reduce password risk.
- [Ably](https://composio.dev/toolkits/ably) - Ably is a real-time messaging platform for live chat and data sync in modern apps. It offers global scale and rock-solid reliability for seamless, instant experiences.
- [Abuselpdb](https://composio.dev/toolkits/abuselpdb) - Abuselpdb is a central database for reporting and checking IPs linked to malicious online activity. Use it to quickly identify and report suspicious or abusive IP addresses.
- [Alchemy](https://composio.dev/toolkits/alchemy) - Alchemy is a blockchain development platform offering APIs and tools for Ethereum apps. It simplifies building and scaling Web3 projects with robust infrastructure.
- [Algolia](https://composio.dev/toolkits/algolia) - Algolia is a hosted search API that powers lightning-fast, relevant search experiences for web and mobile apps. It helps developers deliver instant, typo-tolerant, and scalable search without complex infrastructure.
- [Anakin](https://composio.dev/toolkits/anakin_io) - Anakin is a web automation platform offering scraping, crawling, search, and browser automation. Use it to extract structured data, automate site tasks, and monitor web changes reliably.
- [Anchor browser](https://composio.dev/toolkits/anchor_browser) - Anchor browser is a developer platform for AI-powered web automation. It transforms complex browser actions into easy API endpoints for streamlined web interaction.
- [AnyAPI](https://composio.dev/toolkits/anyapi) - AnyAPI is a marketplace of utility APIs for validation, currency conversion, holidays, documents, and web data. It brings common application workflows together through one practical API platform.
- [Apiflash](https://composio.dev/toolkits/apiflash) - Apiflash is a website screenshot API for programmatically capturing web pages. It delivers high-quality screenshots on demand for automation, monitoring, or reporting.
- [Apiverve](https://composio.dev/toolkits/apiverve) - Apiverve delivers a suite of powerful APIs that simplify integration for developers. It's designed for reliability and scalability so you can build faster, smarter applications without the integration headache.
- [Appcircle](https://composio.dev/toolkits/appcircle) - Appcircle is an enterprise-grade mobile CI/CD platform for building, testing, and publishing mobile apps. It streamlines mobile DevOps so teams ship faster and with more confidence.
- [Appdrag](https://composio.dev/toolkits/appdrag) - Appdrag is a cloud platform for building websites, APIs, and databases with drag-and-drop tools and code editing. It accelerates development and iteration by combining hosting, database management, and low-code features in one place.
- [Appveyor](https://composio.dev/toolkits/appveyor) - AppVeyor is a cloud-based continuous integration service for building, testing, and deploying applications. It helps developers automate and streamline their software delivery pipelines.
- [Authyo](https://composio.dev/toolkits/authyo) - Authyo is a REST API service for passwordless authentication, OTP verification, session management, and transactional notifications. Use it to add secure login flows and user verification without building auth infrastructure from scratch.
- [AWS Marketplace MCP](https://composio.dev/toolkits/aws_marketplace_mcp) - AWS Marketplace MCP provides MCP access to AWS Marketplace's cloud software, data, and services catalog. Use it to discover, compare, and evaluate 30K+ AWS Marketplace listings faster.
- [Azure Monitor Activity Log](https://composio.dev/toolkits/azure_monitor_activity_log) - Azure Monitor Activity Log is Azure's service that records management and control-plane events for a subscription. Use it to audit changes, troubleshoot issues, and track resource operations across your Azure resources.
- [Backendless](https://composio.dev/toolkits/backendless) - Backendless is a backend-as-a-service platform for mobile and web apps, offering database, file storage, user authentication, and APIs. It helps developers ship scalable applications faster without managing server infrastructure.

## Frequently Asked Questions

### Do I need my own developer credentials to use Parse.bot with Composio?

Yes, Parse.bot requires you to configure your own API key. Once set up, Composio handles secure credential storage and API request handling for you.

### Can I use multiple toolkits together?

Yes! Composio's Tool Router enables agents to use multiple toolkits. [Learn more](https://docs.composio.dev/tool-router/overview).

### Is Composio secure?

Composio is SOC 2 and ISO 27001 compliant with all data encrypted in transit and at rest. [Learn more](https://trust.composio.dev).

### What if the API changes?

Composio maintains and updates all toolkit integrations automatically, so your agents always work with the latest API versions.

---
[See all toolkits](https://composio.dev/toolkits) · [Composio docs](https://docs.composio.dev/llms.txt)
