X (Twitter)LinkedInGitHubDiscordYouTube

How to integrate Supadata MCP with DeepSeek Harness

Connect DeepSeek Harness to Supadata MCP. Extract all urls from a competitor website, scrape the main content from a blog post, and more using natural language, with authentication handled for you.

Get started for freeGet a demo
Supadata logoSupadata
Api Key

Supadata is a web and video-to-text API that extracts structured data from videos and websites. It enables fast, automated content parsing for AI training and analysis.

11 Tools

Introduction

DeepSeek Harness (dsh) is an open-source agent runtime from DeepSeek AI, and every part of it is a plugin, so you can swap out the model adapter, the tool registry, or the agent loop. It runs on the Cordis framework and comes with a local Web UI, a headless CLI runner, and a Python SDK. You can point it at DeepSeek V4-Pro and V4-Flash, or at Anthropic, OpenAI, and other OpenAI-compatible providers. It is MIT licensed and still in developer preview.

This guide shows how to connect your Supadata account to DeepSeek Harness, and you can do it with either the Composio Connect CLI or the Composio Connect MCP. The dsh-base bundle gives shell execution as a first-class tool, so the CLI is the easiest path for personal use. It is quick to set up and needs no server config, and the MCP path works well too, since the harness comes with a built-in MCP client.

Also integrate Supadata with

ChatGPT WorkAntigravityOpenAI Agents SDKClaude Agent SDKClaude CodeClaude CoworkCodexGrok BuildCursorVS CodeOpenCodeOpenClawHermesPiGoogle ADKLangChainVercel AI SDKMastra AILlamaIndexCrewAIPydantic AIAutoGen

What is Composio Connect?

Composio Connect lets anyone plug 1,000+ applications directly into their agent harness, including DeepSeek Harness, through a single hosted MCP endpoint. Each task runs as a session, a scoped runtime that ties together the user, the available toolkits, authentication, and execution state. It can:

  • Discover and load tools on-demand. A small set of meta tools lets the agent search for the right tool at runtime, so you never load hundreds of tool definitions into context.
  • Chain tools in a sandboxed remote workbench. Multi-step workflows run server-side, passing outputs between tools and working with files in the session's sandbox, so long chains finish without a lot of back-and-forth with the LLM.
  • Manage authentication end-to-end. Managed OAuth, per-user connected accounts, and account isolation are all handled for you, so you never wire up auth yourself.

Connect Supadata to DeepSeek Harness with Composio

Prerequisites: Install DeepSeek Harness

DeepSeek Harness needs Node.js (20 or 22) and pnpm. Build it from source. This is also what the MCP path in Option 2 requires, since the built-in MCP client resolves its dependencies from the checkout:

bash
git clone https://github.com/deepseek-ai/deepseek-harness.git
cd deepseek-harness
pnpm install
pnpm run build
pnpm dsh web

The Web UI listens on http://127.0.0.1:3080 by default. Open that address to confirm it is up.

Then configure your model route. In the Web UI, open Settings → Models: the built-in DeepSeek card accepts a DeepSeek API key, and the same page supports Anthropic, OpenAI, and custom OpenAI-compatible endpoints. Full first-run details are in the DeepSeek Harness docs.

Option 1: Composio CLI (recommended)

DeepSeek Harness runs shell commands as a first-class tool through its dsh-base bundle, so the Composio Universal CLI fits well. There is no MCP server to configure, and multi-step tool chaining is reliable. Install and authenticate:

bash
# Install the Composio CLI
curl -fsSL https://composio.dev/install | bash

# Log in to Composio
composio login

Connect to Supadata

Ask DeepSeek Harness to connect to Supadata, or just request any Supadata-related task. Under the hood the agent calls Composio commands like any other shell tool:

bash
composio search "what can I do with Supadata?"
composio link supadata

On the first Supadata call, composio link supadata opens an OAuth prompt so you can authorize access. After that, every Supadata command works with your stored credentials automatically, so you just talk to the agent and it will search, execute, and chain Supadata tools as needed.

Option 2: Composio MCP

DeepSeek Harness bridges MCP through its built-in @deepseek-ai/dsh-mcp-client plugin. You register one server as a plugin row, and its tools appear under server-qualified names (mcp__<serverName>__<rawName>), the same shape Claude Code and Codex use.

MCP requires the source build. The built-in client depends on the harness's own internal packages (cordis, dsh-llm, dsh-tools, dsh-invariants, dsh-subprocess), which resolve from the git checkout you built in the prerequisites. Run everything below from that checkout with pnpm dsh. For a route that avoids editing config files, see the community plugin at the end of this section.

Auth note: The built-in client passes static headers only and has no OAuth flow, so authenticate to Composio Connect with the x-consumer-api-key header. For Composio's OAuth flow, use the community plugin below.

1. Register the Composio server

The web profile's user patch layer is $DSH_HOME/profiles/web/cordis.patch.yml ($DSH_HOME defaults to ~/.dsh). This is a patch file, so a new plugin goes under an insert: entry. A bare - id: row instead targets an existing entry and fails to boot with patch: entry "…" not found. Add:

bash
- insert:
    - id: mcp-composio
      name: '@deepseek-ai/dsh-mcp-client'
      config:
        serverName: composio
        transport: streamable-http
        url: https://connect.composio.dev/mcp
        headers:
          x-consumer-api-key: !!js process.env.COMPOSIO_API_KEY

2. Set the API key and launch

The header value must resolve to a string at load time. Export your Composio consumer API key (ck_...), which is on the Connect → Settings → Sessions page of the Composio dashboard, in the shell you launch from. If it is unset, process.env.COMPOSIO_API_KEY is undefined and the config fails validation:

bash
export COMPOSIO_API_KEY=ck_your_key
pnpm dsh web

3. Done!

Open http://127.0.0.1:3080 and start a session on Standard or Code mode. (Minimal mode exposes only bash and str_replace_editor, so it hides MCP tools.) Composio's tools register as mcp__composio__*. Ask DeepSeek Harness to connect to Supadata or request any Supadata-related task, and Composio authorizes Supadata on demand on the first call.

The dsh-mcp-client config schema (transport, serverName, url, headers, plus reconnect.* and toolCallTimeoutMs) is the current developer-preview interface and may change between releases.

Alternative: OAuth via the community plugin

To use Composio Connect's OAuth flow instead of a static key, or to skip editing cordis.patch.yml by hand, use the community dsh-mcp-manager plugin. It installs as a self-contained external plugin, ships a bundle patch so it auto-mounts, and adds a Settings → MCP page plus OAuth (authorization code + PKCE, RFC 7591 dynamic client registration, and refresh-token rotation). It needs the web profile and Node.js ^22.19 or >=24, with pnpm on your PATH.

Install it from your source checkout, then restart pnpm dsh web and refresh:

bash
pnpm dsh plugin --profile web add github:hyqhyq3/dsh-mcp-manager

Open Settings → MCP → ＋ Add MCP server, choose HTTP, set the name to composio, the URL to https://connect.composio.dev/mcp, and the auth mode to OAuth. Click Authenticate, and Composio's login and consent screen opens in the browser, then redirects back and registers the tools as mcp__composio__*. The row should read connected (N tools).

The plugin catches the OAuth code on a loopback redirect (http://127.0.0.1:<port>/mcp-manager/callback/<id>), so Composio's OAuth provider must allow that loopback URL. Server configs and tokens persist at ~/.dsh/mcp-manager.json, so treat that file as a secret. Being a community plugin on a preview harness, its commands may change, so check the plugin repo if a step drifts.

What is the Supadata MCP server, and what's possible with it?

The Supadata MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your Supadata account. It provides structured and secure access to web and video data extraction tools, so your agent can perform actions like scraping websites, mapping URLs, transcribing YouTube videos, and gathering channel or playlist metadata on your behalf.

  • Comprehensive website scraping and content extraction: Instruct your agent to pull structured content from any website, enabling programmatic parsing and analysis for research or automation.
  • Automated sitemap and URL mapping: Let your agent retrieve all URLs from a given website, making it easy to analyze site structure or perform link audits.
  • YouTube video and channel metadata retrieval: Have your agent fetch detailed metadata for any YouTube video, playlist, or channel—including titles, descriptions, stats, and more.
  • YouTube search and discovery: Empower your agent to search YouTube for videos, channels, or playlists by keyword, streamlining content discovery and curation tasks.
  • Playlist and channel video extraction: Direct your agent to list and export videos from specific YouTube channels or playlists, complete with pagination support for large collections.

Way Forward

With Supadata connected, DeepSeek Harness can now act on your behalf whenever you ask it to.

From here, you can extend the harness further:

  • Connect more apps: Calendar, Slack, Notion, Linear, and hundreds of others are available through the same Composio Connect setup, and each new integration adds to what your agent can do for you.
  • Build workflows across tools: Once multiple apps are connected, DeepSeek Harness can chain actions together, so it can turn an email into a calendar invite, a Slack message into a Linear ticket, or a meeting note into a follow-up draft.
  • Use the plugin system: Wrap common Supadata flows as dsh plugins or prompt templates so recurring tasks become one-line commands, and bundle your most-used Supadata tools into a named profile you can boot on demand.

If you run into trouble or want to share what you've built, join the community or check out the Docs for more configuration options.

TOOLS

Supported Tools

Every Supadata action and event your agent gets out of the box.

Get Account Information

Retrieve organization details, plan information, and credit usage for the authenticated account.

Get Video Transcript

Get transcript from a video on supported platforms or from a file URL.

Get Transcript by Job ID

Get results for a transcript job by job ID.

Website URL Map

Crawl a website and extract all URLs/links found on it.

Scrape Web Page

Extract content from any webpage and convert it to Markdown format.

Get YouTube Channel Metadata

Fetches metadata for a YouTube channel including name, description, subscriber count, video count, view count, and channel images.

Get YouTube Channel Videos

Tool to retrieve video IDs from a YouTube channel.

Get YouTube Playlist Metadata

Retrieve metadata for a YouTube playlist including title, description, video count, view count, last updated timestamp, and channel information.

Get YouTube Playlist Videos

Tool to retrieve video IDs from a YouTube playlist.

Get YouTube Video Metadata

Retrieve comprehensive metadata for a YouTube video by its ID.

Search YouTube

Search YouTube for videos, channels, or playlists by keyword.

FRAMEWORKS

How to build Supadata MCP Agent with another framework

ChatGPT Work logo

ChatGPT Work

Use Supadata MCP with ChatGPT Work

Antigravity logo

Antigravity

Use Supadata MCP with Antigravity

OpenAI Agents SDK logo

OpenAI Agents SDK

Use Supadata MCP with OpenAI Agents SDK

Claude Agent SDK logo

Claude Agent SDK

Use Supadata MCP with Claude Agent SDK

Claude Code logo

Claude Code

Use Supadata MCP with Claude Code

Claude Cowork logo

Claude Cowork

Use Supadata MCP with Claude Cowork

Codex logo

Codex

Use Supadata MCP with Codex

Grok Build logo

Grok Build

Use Supadata MCP with Grok Build

Cursor logo

Cursor

Use Supadata MCP with Cursor

VS Code logo

VS Code

Use Supadata MCP with VS Code

OpenCode logo

OpenCode

Use Supadata MCP with OpenCode

OpenClaw logo

OpenClaw

Use Supadata MCP with OpenClaw

Hermes logo

Hermes

Use Supadata MCP with Hermes

Pi logo

Pi

Use Supadata MCP with Pi

Google ADK logo

Google ADK

Use Supadata MCP with Google ADK

LangChain logo

LangChain

Use Supadata MCP with LangChain

Vercel AI SDK logo

Vercel AI SDK

Use Supadata MCP with Vercel AI SDK

Mastra AI logo

Mastra AI

Use Supadata MCP with Mastra AI

LlamaIndex logo

LlamaIndex

Use Supadata MCP with LlamaIndex

CrewAI logo

CrewAI

Use Supadata MCP with CrewAI

Pydantic AI logo

Pydantic AI

Use Supadata MCP with Pydantic AI

AutoGen logo

AutoGen

Use Supadata MCP with AutoGen

FAQ

Frequently asked questions

With a standalone Supadata MCP server, the agents and LLMs can only access a fixed set of Supadata tools tied to that server. However, with the Composio Tool Router, agents can dynamically load tools from Supadata and many other apps based on the task at hand, all through a single MCP endpoint.

Yes, you can. DeepSeek Harness fully supports MCP integration. You get structured tool calling, message history handling, and model orchestration while Tool Router takes care of discovering and serving the right Supadata tools.

Yes, absolutely. You can configure which Supadata scopes and actions are allowed when connecting your account to Composio. You can also bring your own OAuth credentials or API configuration so you keep full control over what the agent can do.

All sensitive data such as tokens, keys, and configuration is fully encrypted at rest and in transit. Composio is SOC 2 Type 2 compliant and follows strict security practices so your Supadata data and credentials are handled as safely as possible.

Start with Supadata.It takes 30 seconds.

Managed auth, hosted MCP servers, and every Supadata tool your agent needs.Free to start.

Start building