RunPod Integration for AI Agents

Securely connect your AI agents and chatbots (Claude, ChatGPT, Cursor, etc) with RunPod MCP or direct API to launch pods, monitor GPU usage, manage jobs, and query pod status through natural language.
GET STARTED FOR FREE
RunPod Logo
Gradient Top
Gradient Middle
Gradient Bottom
divider

Try RunPod now

Enter a prompt below to test the integration in our Tool Router playground. You'll be redirected to sign in and try it live.

Supported Tools

Tools
Create RunPod ClusterTool to create a new GPU cluster for multi-node distributed computing workloads on RunPod.
Create SecretTool to create a new secure secret in RunPod for credential management.
Delete Container Registry AuthenticationTool to delete container registry authentication from RunPod.
Delete TemplateTool to remove a RunPod template via GraphQL mutation.
Get GPU TypesTool to retrieve available GPU types and their specifications, pricing, and availability from RunPod.
Get authenticated user infoRetrieve basic information about the authenticated user including ID, email, and security settings.
Get Pod DetailsRetrieve details of a specific RunPod pod by its unique pod ID.
List CPU TypesTool to retrieve available CPU types and their specifications from RunPod.
Save Serverless EndpointTool to create or update a RunPod serverless endpoint with GPU configuration and scaling settings.
Save Container Registry AuthenticationTool to save container registry authentication credentials for accessing private Docker images in RunPod.
Save TemplateTool to create a new RunPod template or update an existing one with container configuration.
Update Registry AuthTool to update existing container registry authentication credentials in RunPod.
Update User SettingsTool to update current user settings (e.
Python
TypeScript

Install Composio

python
pip install composio claude-agent-sdk
Install the Composio SDK for Python or TypeScript

Initialize Client and Create Tool Router Session

python
from composio import Composio
from claude_agent_sdk import ClaudeSDKClient, ClaudeAgentOptions

composio = Composio(api_key='your-composio-api-key')
session = composio.create(user_id='your-user-id')
url = session.mcp.url
Import and initialize the Composio client, then create a Tool Router session for RunPod

Connect to AI Agent

python
import asyncio

options = ClaudeAgentOptions(
    permission_mode='bypassPermissions',
    mcp_servers={
        'tool_router': {
            'type': 'http',
            'url': url,
            'headers': {
                'x-api-key': 'your-composio-api-key'
            }
        }
    },
    system_prompt='You are a helpful assistant with access to RunPod tools.',
    max_turns=10
)

async def main():
    async with ClaudeSDKClient(options=options) as client:
        await client.query('Get status of all running GPU pods')
        async for message in client.receive_response():
            if hasattr(message, 'content'):
                for block in message.content:
                    if hasattr(block, 'text'):
                        print(block.text)

asyncio.run(main())
Use the MCP server with your AI agent (Anthropic Claude or Mastra)

Why Use Composio?

AI Native RunPod Integration

  • Supports both RunPod MCP and direct API based integrations
  • Structured, LLM-friendly schemas for reliable tool execution
  • Rich coverage for reading, writing, and querying your RunPod data

Managed Auth

  • Built-in OAuth handling with automatic token refresh and rotation
  • Central place to manage, scope, and revoke RunPod access
  • Per user and per environment credentials instead of hard-coded keys

Agent Optimized Design

  • Tools are tuned using real error and success rates to improve reliability over time
  • Comprehensive execution logs so you always know what ran, when, and on whose behalf

Enterprise Grade Security

  • Fine-grained RBAC so you control which agents and users can access RunPod
  • Scoped, least privilege access to RunPod resources
  • Full audit trail of agent actions to support review and compliance

Use RunPod with any AI Agent Framework

Choose a Framework you want to connect RunPod with

Frequently Asked Questions

Do I need my own developer credentials to use RunPod with Composio?

Yes, RunPod requires you to configure your own API key credentials. Once set up, Composio handles secure credential storage and API request handling for you.

Can I use multiple toolkits together?

Yes! Composio's Tool Router enables agents to use multiple toolkits. Learn more.

Is Composio secure?

Composio is SOC 2 and ISO 27001 compliant with all data encrypted in transit and at rest. Learn more.

What if the API changes?

Composio maintains and updates all toolkit integrations automatically, so your agents always work with the latest API versions.

Used by agents from

Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai
Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai
Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai

Never worry about agent reliability

We handle tool reliability, observability, and security so you never have to second-guess an agent action.

Book a call↗Get started for free