How to integrate ScrapeCreators MCP with Hermes

Connect Hermes to ScrapeCreators MCP. Scrape recent posts from username, extract public profile and follower counts, and more using natural language, with authentication handled for you.

ScrapeCreators logoScrapeCreators
Api Key

ScrapeCreators is a scraping service that extracts public profiles, posts, videos, comments, ads, and other content from social platforms. Use it to quickly collect structured public social data for analysis, monitoring, and content research.

55 Tools

Introduction

Hermes is a 24/7 autonomous agent that lives on your computer or server — it remembers what it learns and evolves as your usage grows.

This guide explains the easiest and most robust way to connect your ScrapeCreators account to Hermes. You can do this through either Composio Connect CLI or Composio Connect MCP. For personal use we recommend the CLI, but you won't go wrong with MCP either.

Also integrate ScrapeCreators with

What is Composio Connect?

Composio Connect is a consumer offering that lets anyone plug 1,500+ applications directly into their agent harness — including Hermes. It can:

  • Search and load tools from relevant toolkits on-demand, reducing context usage.
  • Chain multiple tools to accomplish complex workflows via a remote workbench, without excessive back-and-forth with the LLM.
  • Manage app authentication end-to-end with zero manual overhead.

Integrating ScrapeCreators with Hermes

Using Composio Connect CLI

1. Install the Composio CLI

Run the install script directly, or paste https://composio.dev/hermes into your Hermes chat box to have it installed for you.

bash
curl -fsSL https://composio.dev/install | bash
Hermes authenticating with Composio

2. Authenticate

Once the CLI is installed, ask Hermes to authenticate with Composio.

3. Connect to ScrapeCreators

Ask your agent to connect to ScrapeCreators, or simply request any ScrapeCreators-related task. Hermes will prompt you to authenticate and authorize access.

4. Done. You're all set with a new ScrapeCreators connection.


Using Composio Connect MCP

1. Get your MCP URL and API Key

Go to dashboard.composio.dev and copy your Connect MCP URL and API key.

Copy MCP URL and API key from Composio dashboard

2. Open the Hermes config file

bash
nano ~/.hermes/config.yaml

3. Add the Composio Connect MCP server

bash
mcp_servers:
  composio:
    url: "https://connect.composio.dev/mcp"
    headers:
      x-consumer-api-key: "YOUR_COMPOSIO_API_KEY"
    connect_timeout: 60
    timeout: 180

Save with Ctrl + O, Enter, then exit with Ctrl + X.

4. Restart your Hermes agent

Once restarted, ask your agent to connect to ScrapeCreators or request any ScrapeCreators-related task. It will prompt you to authenticate and authorize access.

5. Done!

What is the ScrapeCreators MCP server, and what's possible with it?

The ScrapeCreators MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your ScrapeCreators account. It provides structured and secure access so your agent can perform ScrapeCreators operations on your behalf.

Way Forward

With ScrapeCreators connected, Hermes can now act on your behalf whenever it detects a relevant task or you ask it to.

From here, you can extend Hermes further:

  • Connect more apps: Calendar, Slack, Notion, Linear, and hundreds of others are available through the same Composio Connect setup. Each new integration compounds what Hermes can do for you.
  • Build workflows across tools: Once multiple apps are connected, Hermes can chain actions together — turn an email into a calendar invite, a Slack message into a Linear ticket, or a meeting note into a follow-up draft.
  • Let it learn your patterns: The more you use Hermes, the better it gets at anticipating how you'd handle recurring tasks. Give it feedback on drafts and decisions, and it will adapt.

If you run into trouble or want to share what you've built, join the community or check out the Docs for deeper configuration options.

TOOLS

Supported Tools

Every ScrapeCreators action and event your agent gets out of the box.

Find Creator Social Profiles

Discover and verify a creator's linked profiles across supported social platforms from one source handle.

Get Credit Balance

Return the connected ScrapeCreators account's remaining prepaid credit balance without consuming credits.

Get Facebook Ad

Return creative, advertiser, platform, delivery, spend, reach, and active-period details for one Meta Ad Library ad.

Get Facebook Post

Return content, author, media, engagement, and the feedback ID for one public Facebook post or reel.

Get Facebook Profile

Return public identity, audience, contact, business, and Ad Library metadata for one Facebook profile or Page.

Get GitHub Repository

Return public metadata, ownership, popularity, language, topics, license, and activity for one GitHub repository.

Get GitHub User

Return public identity, biography, organization, location, social links, and repository and follower counts for one GitHub user.

Get GitHub User Contributions

Return a GitHub user's public contribution graph for one year, including the annual total and daily counts and intensity levels.

Get Google Ad

Return creative variations, advertiser, format, regions, impression estimates, and display dates for one Google Ads Transparency ad.

Get Instagram Media Transcript

Transcribe speech from an Instagram video or reel under two minutes, returning one transcript per video slide when applicable.

Get Instagram Post

Return detailed metadata and engagement for one Instagram post or reel.

Get Instagram Profile

Return public identity, biography, verification, links, and account statistics for one Instagram profile; this does not return the post feed.

Get LinkedIn Ad

Return advertiser, creative, destination, targeting, impressions, and run dates for one public LinkedIn ad.

Get LinkedIn Company

Return public company identity, industry, workforce, funding, headquarters, specialties, and website data from LinkedIn.

Get LinkedIn Post

Return content, author, publication date, engagement, and embedded comments for one public LinkedIn post or article.

Get LinkedIn Profile

Return public professional identity, experience, education, activity, and audience data for one LinkedIn person profile.

Get Reddit Post

Return content, author, community, score, flags, media URL, and comment count for one public Reddit post.

Get Reddit Subreddit

Return public metadata, rules, audience size, and activity statistics for one subreddit.

Get Threads Post

Return content, author, media, engagement, comments, and related context for one public Threads post.

Get Threads Profile

Return public identity, biography, links, verification, privacy, and follower data for one Threads profile.

Get TikTok Ad

Return creative, advertiser, objective, landing-page, performance, audience, and video details for one TikTok ad.

Get TikTok Profile

Return public identity, bio, verification, and account statistics for one TikTok creator; this does not return the creator's video feed.

Get TikTok Video

Return metadata, engagement, author, music, and media URLs for one TikTok video.

Get TikTok Video Transcript

Extract a timestamped WEBVTT transcript from a TikTok video under two minutes.

Get Twitter Profile

Return public identity, biography, verification, audience, business, and subscription metadata for one X/Twitter account.

Get Twitter Tweet

Return content, author, media, views, and engagement for one public X/Twitter post.

Get Twitter Tweet Transcript

Return the available transcript for a video under two minutes attached to one public X/Twitter post.

Get YouTube Channel

Return public profile, subscriber and view statistics, tags, country, and linked accounts for one YouTube channel.

Get YouTube Video

Return metadata, engagement, chapters, creator, paid-promotion status, and caption-track availability for one YouTube video or Short.

Get YouTube Video Transcript

Return timestamped and plain-text public captions for a YouTube video or Short, including long videos when captions exist.

List Facebook Company Ads

Return one page of Meta Ad Library ads for a company or Page with delivery, status, media, language, date, and sort filters.

List Facebook Post Comments

Return one page of comments on a Facebook post or reel, accepting its URL or the faster feedback ID.

List Facebook Profile Posts

Return one page of up to three public posts from a Facebook profile or Page with a cursor for the next page.

List GitHub Trending Repositories

Return GitHub's current trending repositories filtered by programming language, period, and optional spoken language.

List GitHub User Activity

Return one month page of a GitHub user's public contribution activity for a selected year.

List GitHub User Pull Requests

Return one page of a GitHub user's public pull requests, sorted newest first, with optional creation-date filters and a cursor for the next page.

List GitHub User Repositories

Return one page of repositories associated with a GitHub user, filtered by ownership and sort order, with a cursor for the next page.

List Google Company Ads

Return one page of Google Ads Transparency creatives for a company.

List Instagram Post Comments

Return one page of comments on an Instagram post or reel.

List Instagram User Posts

Return one page of a public Instagram user's posts, reels, photos, videos, and carousels with a cursor for the next page.

List LinkedIn Company Posts

Return one numeric page of public posts from a LinkedIn company Page.

List Reddit Post Comments

Return one page of public comments or replies for a Reddit post.

List Reddit Subreddit Posts

Return one page of posts from a subreddit with sort and timeframe controls and an opaque cursor for the next page.

List Threads User Posts

Return the currently public recent posts for one Threads profile in a single response.

List TikTok Profile Videos

Return one page of a TikTok creator's posted videos, sorted by latest or popularity, with a cursor for the next page.

List Twitter User Tweets

Return the public tweets currently exposed for one X/Twitter account in a single response.

List YouTube Channel Videos

Return one page of videos uploaded by a YouTube channel, sorted by latest or popularity, with an opaque cursor for the next page.

Search Facebook Ad Library

Search Meta's public Ad Library by keyword with country, language, status, media, date, and political-ad filters, returning one page and an opaque cursor.

Search Google Advertisers

Search Google Ads Transparency advertisers by name or keyword in one country.

Search LinkedIn Ads

Search LinkedIn's public Ad Library by company, company ID, or keyword with country and date filters, returning one page and an opaque cursor.

Search LinkedIn Posts

Search Google-indexed public LinkedIn posts by keyword and optional recency, returning one page and a bounded continuation cursor.

Search Reddit

Search Reddit posts or comments by keyword with type, sort, and timeframe filters, returning one page and a continuation cursor.

Search Threads Posts

Search public Threads posts by keyword and optional inclusive date range, returning the provider's single, non-pageable result set.

Search TikTok Ad Library

Search TikTok's public ad library by general query or advertiser name, returning one page and an opaque cursor.

Search YouTube

Search YouTube for videos, Shorts, channels, or playlists with date, popularity, duration, and region filters, returning one page and a continuation cursor.

FAQ

Frequently asked questions

With a standalone ScrapeCreators MCP server, the agents and LLMs can only access a fixed set of ScrapeCreators tools tied to that server. However, with the Composio Tool Router, agents can dynamically load tools from ScrapeCreators and many other apps based on the task at hand, all through a single MCP endpoint.

Yes, you can. Hermes fully supports MCP integration. You get structured tool calling, message history handling, and model orchestration while Tool Router takes care of discovering and serving the right ScrapeCreators tools.

Yes, absolutely. You can configure which ScrapeCreators scopes and actions are allowed when connecting your account to Composio. You can also bring your own OAuth credentials or API configuration so you keep full control over what the agent can do.

All sensitive data such as tokens, keys, and configuration is fully encrypted at rest and in transit. Composio is SOC 2 Type 2 compliant and follows strict security practices so your ScrapeCreators data and credentials are handled as safely as possible.

Start with ScrapeCreators.It takes 30 seconds.

Managed auth, hosted MCP servers, and every ScrapeCreators tool your agent needs.Free to start.

Start building