# How to integrate Webscraper io MCP with Hermes

```json
{
  "title": "How to integrate Webscraper io MCP with Hermes",
  "toolkit": "Webscraper io",
  "toolkit_slug": "webscraper_io",
  "framework": "Hermes",
  "framework_slug": "hermes-agent",
  "url": "https://composio.dev/toolkits/webscraper_io/framework/hermes-agent",
  "markdown_url": "https://composio.dev/toolkits/webscraper_io/framework/hermes-agent.md",
  "updated_at": "2026-03-29T06:55:06.134Z"
}
```

## Introduction

Hermes is a 24/7 autonomous agent that lives on your computer or server — it remembers what it learns and evolves as your usage grows.
This guide explains the easiest and most robust way to connect your Webscraper io account to Hermes. You can do this through either Composio Connect CLI or Composio Connect MCP. For personal use we recommend the CLI, but you won't go wrong with MCP either.

## Also integrate Webscraper io with

- [OpenAI Agents SDK](https://composio.dev/toolkits/webscraper_io/framework/open-ai-agents-sdk)
- [Claude Agent SDK](https://composio.dev/toolkits/webscraper_io/framework/claude-agents-sdk)
- [Claude Code](https://composio.dev/toolkits/webscraper_io/framework/claude-code)
- [Claude Cowork](https://composio.dev/toolkits/webscraper_io/framework/claude-cowork)
- [Codex](https://composio.dev/toolkits/webscraper_io/framework/codex)
- [OpenClaw](https://composio.dev/toolkits/webscraper_io/framework/openclaw)
- [CLI](https://composio.dev/toolkits/webscraper_io/framework/cli)
- [Google ADK](https://composio.dev/toolkits/webscraper_io/framework/google-adk)
- [LangChain](https://composio.dev/toolkits/webscraper_io/framework/langchain)
- [Vercel AI SDK](https://composio.dev/toolkits/webscraper_io/framework/ai-sdk)
- [Mastra AI](https://composio.dev/toolkits/webscraper_io/framework/mastra-ai)
- [LlamaIndex](https://composio.dev/toolkits/webscraper_io/framework/llama-index)
- [CrewAI](https://composio.dev/toolkits/webscraper_io/framework/crew-ai)

## TL;DR

### What is Composio Connect?
Composio Connect is a consumer offering that lets anyone plug 1,000+ applications directly into their agent harness — including Hermes. It can:
- Search and load tools from relevant toolkits on-demand, reducing context usage.
- Chain multiple tools to accomplish complex workflows via a remote workbench, without excessive back-and-forth with the LLM.
- Manage app authentication end-to-end with zero manual overhead.

## Connect Webscraper io to Hermes

### Integrating Webscraper io with Hermes
### Using Composio Connect CLI
1. Install the Composio CLI
Run the install script directly, or paste https://composio.dev/hermes into your Hermes chat box to have it installed for you.

```bash
curl -fsSL https://composio.dev/install | bash
```

## What is the Webscraper io MCP server, and what's possible with it?

The Webscraper io MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your Webscraper io account. It provides structured and secure access so your agent can perform Webscraper io operations on your behalf.

## Supported Tools

| Tool slug | Name | Description |
|---|---|---|
| `WEBSCRAPER_IO_CREATE_SITEMAP` | Create Sitemap | Tool to create a new sitemap configuration for web scraping. Use when you need to define a new scraping structure with start URLs and selector rules for data extraction from a website. |
| `WEBSCRAPER_IO_DELETE_SITEMAP` | Delete Sitemap | Tool to permanently delete a sitemap configuration from Web Scraper Cloud account. Use when you need to remove a sitemap that is no longer needed. |
| `WEBSCRAPER_IO_DISABLE_SITEMAP_SCHEDULER` | Disable Sitemap Scheduler | Tool to disable automatic scheduling for a sitemap. Use when you need to stop automated scraping jobs from running on a schedule. |
| `WEBSCRAPER_IO_ENABLE_SITEMAP_SCHEDULER` | Enable Sitemap Scheduler | Tool to enable and configure automatic scheduling for sitemap scraping jobs. Use when you need to automate scraping jobs to run at specific times using cron expressions with customizable request intervals, page load delays, driver types, and proxy settings. |
| `WEBSCRAPER_IO_GET_ACCOUNT_INFO` | Get Account Info | Tool to retrieve account information including email and page credits. Use when you need to check account details or available credits. |
| `WEBSCRAPER_IO_GET_SCRAPING_JOBS` | Get Scraping Jobs | Tool to retrieve all scraping jobs for the account with optional filtering and pagination. Use when you need to list scraping jobs, check job status, or filter jobs by sitemap or tag. |
| `WEBSCRAPER_IO_GET_SITEMAP` | Get Sitemap | Tool to retrieve a specific sitemap configuration by ID. Use when you need to inspect or reference an existing sitemap's configuration. |
| `WEBSCRAPER_IO_GET_SITEMAPS` | Get Sitemaps | Tool to retrieve all sitemaps for the authenticated account with pagination support. Use when you need to list available sitemaps or filter them by tag. Supports optional pagination via page parameter and filtering by tag name. |
| `WEBSCRAPER_IO_GET_SITEMAP_SCHEDULER` | Get Sitemap Scheduler | Tool to retrieve scheduler configuration for a sitemap. Use when you need to check scheduling settings including cron configuration and proxy settings. |
| `WEBSCRAPER_IO_UPDATE_SITEMAP` | Update Sitemap | Tool to update an existing sitemap configuration including structure, URLs, and selectors. Use when you need to modify sitemap settings. |

## Supported Triggers

None listed.

## Creating MCP Server - Stand-alone vs Composio SDK

The Webscraper io MCP server provides comprehensive access to Webscraper io operations through Composio. Once connected, Hermes can perform all major Webscraper io actions on your behalf using natural language commands.

## Complete Code

None listed.

## Conclusion

### Way Forward
With Webscraper io connected, Hermes can now act on your behalf whenever it detects a relevant task or you ask it to.
From here, you can extend Hermes further:
- Connect more apps: Calendar, Slack, Notion, Linear, and hundreds of others are available through the same Composio Connect setup. Each new integration compounds what Hermes can do for you.
- Build workflows across tools: Once multiple apps are connected, Hermes can chain actions together — turn an email into a calendar invite, a Slack message into a Linear ticket, or a meeting note into a follow-up draft.
- Let it learn your patterns: The more you use Hermes, the better it gets at anticipating how you'd handle recurring tasks. Give it feedback on drafts and decisions, and it will adapt.
If you run into trouble or want to share what you've built, join the [community](https://discord.com/invite/composio) or check out the [Docs](https://docs.composio.dev?utm_source=toolkits&utm_medium=framework_template&utm_campaign=hermes&utm_content=docs) for deeper configuration options.

## How to build Webscraper io MCP Agent with another framework

- [OpenAI Agents SDK](https://composio.dev/toolkits/webscraper_io/framework/open-ai-agents-sdk)
- [Claude Agent SDK](https://composio.dev/toolkits/webscraper_io/framework/claude-agents-sdk)
- [Claude Code](https://composio.dev/toolkits/webscraper_io/framework/claude-code)
- [Claude Cowork](https://composio.dev/toolkits/webscraper_io/framework/claude-cowork)
- [Codex](https://composio.dev/toolkits/webscraper_io/framework/codex)
- [OpenClaw](https://composio.dev/toolkits/webscraper_io/framework/openclaw)
- [CLI](https://composio.dev/toolkits/webscraper_io/framework/cli)
- [Google ADK](https://composio.dev/toolkits/webscraper_io/framework/google-adk)
- [LangChain](https://composio.dev/toolkits/webscraper_io/framework/langchain)
- [Vercel AI SDK](https://composio.dev/toolkits/webscraper_io/framework/ai-sdk)
- [Mastra AI](https://composio.dev/toolkits/webscraper_io/framework/mastra-ai)
- [LlamaIndex](https://composio.dev/toolkits/webscraper_io/framework/llama-index)
- [CrewAI](https://composio.dev/toolkits/webscraper_io/framework/crew-ai)

## Related Toolkits

- [Google Sheets](https://composio.dev/toolkits/googlesheets) - Google Sheets is a cloud-based spreadsheet tool for real-time collaboration and data analysis. It lets teams work together from anywhere, updating information instantly.
- [Notion](https://composio.dev/toolkits/notion) - Notion is a collaborative workspace for notes, docs, wikis, and tasks. It streamlines team knowledge, project tracking, and workflow customization in one place.
- [Airtable](https://composio.dev/toolkits/airtable) - Airtable combines the flexibility of spreadsheets with the power of a database for easy project and data management. Teams use Airtable to organize, track, and collaborate with custom views and automations.
- [Asana](https://composio.dev/toolkits/asana) - Asana is a collaborative work management platform for teams to organize and track projects. It streamlines teamwork, boosts productivity, and keeps everyone aligned on goals.
- [Google Tasks](https://composio.dev/toolkits/googletasks) - Google Tasks is a to-do list and task management tool integrated into Gmail and Google Calendar. It helps you organize, track, and complete tasks across your Google ecosystem.
- [Linear](https://composio.dev/toolkits/linear) - Linear is a modern issue tracking and project planning tool for fast-moving teams. It helps streamline workflows, organize projects, and boost productivity.
- [Jira](https://composio.dev/toolkits/jira) - Jira is Atlassian’s platform for bug tracking, issue tracking, and agile project management. It helps teams organize work, prioritize tasks, and deliver projects efficiently.
- [Clickup](https://composio.dev/toolkits/clickup) - ClickUp is an all-in-one productivity platform for managing tasks, docs, goals, and team collaboration. It streamlines project workflows so teams can work smarter and stay organized in one place.
- [Monday](https://composio.dev/toolkits/monday) - Monday.com is a customizable work management platform for project planning and collaboration. It helps teams organize tasks, automate workflows, and track progress in real time.
- [Addressfinder](https://composio.dev/toolkits/addressfinder) - Addressfinder is a data quality platform for verifying addresses, emails, and phone numbers. It helps you ensure accurate customer and contact data every time.
- [Agiled](https://composio.dev/toolkits/agiled) - Agiled is an all-in-one business management platform for CRM, projects, and finance. It helps you streamline workflows, consolidate client data, and manage business processes in one place.
- [Ascora](https://composio.dev/toolkits/ascora) - Ascora is a cloud-based field service management platform for service businesses. It streamlines scheduling, invoicing, and customer operations in one place.
- [Basecamp](https://composio.dev/toolkits/basecamp) - Basecamp is a project management and team collaboration tool by 37signals. It helps teams organize tasks, share files, and communicate efficiently in one place.
- [Beeminder](https://composio.dev/toolkits/beeminder) - Beeminder is an online goal-tracking platform that uses monetary pledges to keep you motivated. Stay accountable and hit your targets with real financial incentives.
- [Boxhero](https://composio.dev/toolkits/boxhero) - Boxhero is a cloud-based inventory management platform for SMBs, offering real-time updates, barcode scanning, and team collaboration. It helps businesses streamline stock tracking and analytics for smarter inventory decisions.
- [Breathe HR](https://composio.dev/toolkits/breathehr) - Breathe HR is cloud-based HR software for SMEs to manage employee data, absences, and performance. It simplifies HR admin, making it easy to keep employee records accurate and up to date.
- [Breeze](https://composio.dev/toolkits/breeze) - Breeze is a project management platform designed to help teams plan, track, and collaborate on projects. It streamlines workflows and keeps everyone on the same page.
- [Bugherd](https://composio.dev/toolkits/bugherd) - Bugherd is a visual feedback and bug tracking tool for websites. It helps teams and clients report website issues directly on live sites for faster fixes.
- [Canny](https://composio.dev/toolkits/canny) - Canny is a platform for managing customer feedback and feature requests. It helps teams prioritize product decisions based on real user insights.
- [Chmeetings](https://composio.dev/toolkits/chmeetings) - Chmeetings is a church management platform for events, members, donations, and volunteers. It streamlines church operations and improves community engagement.

## Frequently Asked Questions

### What are the differences in Tool Router MCP and Webscraper io MCP?

With a standalone Webscraper io MCP server, the agents and LLMs can only access a fixed set of Webscraper io tools tied to that server. However, with the Composio Tool Router, agents can dynamically load tools from Webscraper io and many other apps based on the task at hand, all through a single MCP endpoint.

### Can I use Tool Router MCP with Hermes?

Yes, you can. Hermes fully supports MCP integration. You get structured tool calling, message history handling, and model orchestration while Tool Router takes care of discovering and serving the right Webscraper io tools.

### Can I manage the permissions and scopes for Webscraper io while using Tool Router?

Yes, absolutely. You can configure which Webscraper io scopes and actions are allowed when connecting your account to Composio. You can also bring your own OAuth credentials or API configuration so you keep full control over what the agent can do.

### How safe is my data with Composio Tool Router?

All sensitive data such as tokens, keys, and configuration is fully encrypted at rest and in transit. Composio is SOC 2 Type 2 compliant and follows strict security practices so your Webscraper io data and credentials are handled as safely as possible.

---
[See all toolkits](https://composio.dev/toolkits) · [Composio docs](https://docs.composio.dev/llms.txt)