How to integrate Griptape MCP with Pydantic AI

Trusted by
AWS
Glean
Zoom
Airtable
GET STARTED FOR FREEGET A DEMO

30 min · no commitment · see it on your stack

Griptape logo
Pydantic AI logo
divider

Introduction

This guide walks you through connecting Griptape to Pydantic AI using the Composio tool router. By the end, you'll have a working Griptape agent that can create a new assistant named 'dochelper', list all assistants available in your workspace, start a run for assistant 'codegenpro' with input data through natural language commands.

This guide will help you understand how to give your Pydantic AI agent real control over a Griptape account through Composio's Griptape MCP server.

Before we dive in, let's take a quick look at the key ideas and tools involved.

Also integrate Griptape with

TL;DR

Here's what you'll learn:
  • How to set up your Composio API key and User ID
  • How to create a Composio Tool Router session for Griptape
  • How to attach an MCP Server to a Pydantic AI agent
  • How to stream responses and maintain chat history
  • How to build a simple REPL-style chat interface to test your Griptape workflows

What is Pydantic AI?

Pydantic AI is a Python framework for building AI agents with strong typing and validation. It leverages Pydantic's data validation capabilities to create robust, type-safe AI applications.

Key features include:

  • Type Safety: Built on Pydantic for automatic data validation
  • MCP Support: Native support for Model Context Protocol servers
  • Streaming: Built-in support for streaming responses
  • Async First: Designed for async/await patterns

What is the Griptape MCP server, and what's possible with it?

The Griptape MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your Griptape account. It provides structured and secure access to your Griptape platform, so your agent can create assistants, launch and monitor AI runs, retrieve logs, and analyze results automatically on your behalf.

  • Automated assistant creation and management: Easily direct your agent to create new assistants or list existing ones, making it simple to manage your AI resources in Griptape Cloud.
  • Launching and controlling assistant runs: Let your agent start new assistant runs, cancel ongoing executions, or fetch the status of any run for streamlined AI workflow management.
  • Real-time monitoring of assistant activities: Have your agent stream live run events, monitor progress, or retrieve detailed logs to keep tabs on every step of your generative AI processes.
  • Error handling and diagnostics: Ask your agent to fetch detailed error reports for failed runs, helping you troubleshoot and resolve issues quickly and efficiently.
  • Result retrieval and historical analysis: Automatically pull final outputs from completed runs and review historical execution data, empowering you to analyze and improve your generative AI pipelines over time.

Supported Tools & Triggers

Tools
Assistant CreationTool to create a new assistant.
List AssistantsTool to list all assistants.
Cancel Assistant RunTool to cancel an ongoing assistant run.
Assistant Run CreationCreates a new assistant run to execute a conversation turn with a Griptape Cloud assistant.
Get Assistant Run Error DetailsTool to fetch detailed error information for a specific assistant run.
List Assistant RunsTool to list all runs for a given assistant.
Assistant Run Logs RetrievalRetrieve the complete execution logs for an assistant run in Griptape Cloud.
Retrieve Assistant RunTool to retrieve an assistant run's status and details.
Retry Assistant RunTool to attempt retrying a failed assistant run.
Cancel Data JobTool to cancel a running or queued data job.
Create BucketTool to create a new bucket in Griptape Cloud.
Create Bucket AssetTool to create a new asset in a Griptape Cloud bucket.
Create Data ConnectorTool to create a new data connector in Griptape Cloud.
Create Data Connector JobTool to create a data job for a data connector in Griptape Cloud.
Create Export JobTool to create a new export job in Griptape Cloud.
Create FunctionTool to create a new function in Griptape Cloud.
Create Function DeploymentTool to create a new deployment for a function from a code source.
Create Import JobTool to create a new import job in Griptape Cloud.
Create IntegrationTool to create a new integration in Griptape Cloud.
Create Knowledge BaseTool to create a new knowledge base in Griptape Cloud.
Create Knowledge Base JobTool to create a knowledge base job for ingesting data into a knowledge base.
Create LibraryTool to create a new library in Griptape Cloud.
Create Model ConfigurationTool to create a new model configuration in Griptape Cloud.
Create Model Auth ConfigTool to create a model authentication configuration in Griptape Cloud.
Create Organization API KeyTool to create a new API key for a specific organization.
Create RetrieverTool to create a new retriever in Griptape Cloud.
Create RuleTool to create a new rule in Griptape Cloud.
Create SecretTool to create a new secret in Griptape Cloud.
Create StructureTool to create a new structure in Griptape Cloud.
Create Structure DeploymentTool to create a new deployment for a structure.
Create ThreadTool to create a new thread in Griptape Cloud.
Create Thread MessageTool to create a new message in a specific thread.
Create Tool DeploymentCreate a new deployment for a tool from a GitHub repository.
Delete API KeyTool to delete an API key by ID.
Delete AssistantTool to delete an assistant by ID.
Delete BucketTool to delete a bucket by ID.
Delete Bucket AssetTool to delete a specific asset from a Griptape Cloud bucket.
Delete Data ConnectorTool to delete a data connector.
Delete FunctionTool to delete a function from Griptape Cloud.
Delete IntegrationTool to delete an integration by ID.
Delete Knowledge BaseTool to delete a Knowledge Base from Griptape Cloud.
Delete LibraryTool to delete a library from Griptape Cloud.
Delete MessageTool to delete a message by its ID.
Delete Model ConfigurationTool to delete a model configuration from Griptape Cloud.
Delete Model Auth ConfigTool to delete a model auth config by ID.
Delete RuleTool to delete a rule by its ID.
Delete RulesetTool to permanently delete a ruleset from Griptape Cloud by its ID.
Delete SecretTool to delete a secret from Griptape Cloud.
Delete StructureTool to delete a structure from Griptape Cloud.
Delete ThreadTool to delete a thread by its ID.
Delete ToolTool to delete a tool from Griptape Cloud.
Get API KeyTool to retrieve an API key's details.
Get AssistantTool to retrieve a specific assistant's details by ID.
Get Billing Management URLTool to retrieve the billing management portal URL.
Get BucketTool to retrieve a bucket's details by its ID.
Get Bucket AssetTool to retrieve a specific asset from a Griptape Cloud bucket.
Get Bucket Asset URLTool to generate a signed URL for accessing or uploading bucket assets.
Get ConfigurationTool to retrieve Griptape Cloud configuration.
Get Credits BalanceTool to retrieve the current credits balance.
Get Data ConnectorTool to retrieve a data connector's configuration and details from Griptape Cloud.
Get Data JobTool to retrieve a data job's status and details by its ID.
Get Export JobTool to retrieve an export job by ID.
Get FunctionTool to retrieve a function's details.
Get Import JobTool to retrieve an import job's status and details.
Get IntegrationTool to retrieve a specific integration's details by ID.
Get Knowledge BaseTool to retrieve a knowledge base's configuration and details from Griptape Cloud.
Get Knowledge Base JobTool to retrieve a knowledge base job's status and details by its ID.
Get Knowledge Base SearchTool to retrieve details of a specific knowledge base search by its ID.
Get LibraryTool to retrieve a specific library's details by ID.
Get MessageTool to retrieve a specific message's details by ID.
Get Model ConfigurationTool to retrieve a model configuration's details by its ID.
Get Model Auth ConfigTool to retrieve a model auth config by ID.
Get OrganizationTool to retrieve an organization's details by its ID.
Get RetrieverTool to retrieve a retriever's details by its ID.
Get Retriever ComponentTool to retrieve a retriever component's details by its ID.
Get RuleTool to retrieve a specific rule's details by ID.
Get RulesetTool to retrieve a specific ruleset's details by ID.
Get Ruleset by AliasRetrieve a ruleset from Griptape Cloud by its unique alias identifier.
Get SecretTool to retrieve a secret's details from Griptape Cloud.
Get StructureTool to retrieve a structure's configuration and details from Griptape Cloud.
Get Structures DashboardTool to retrieve dashboard metrics for structures.
Get ThreadTool to retrieve a specific thread's details by ID.
Get ToolTool to retrieve a specific tool's details by ID.
Get UsageTool to retrieve current usage statistics.
Get UserTool to retrieve a user's details by their ID.
List Assistant Run EventsTool to list events for an assistant run with pagination support.
List Bucket AssetsTool to list assets in a bucket.
List BucketsTool to list all buckets in Griptape Cloud.
List ConnectionsTool to list all connections.
List Data ConnectorsTool to list all data connectors.
List Embedding DriversTool to list available embedding drivers.
List Export JobsTool to list export jobs from Griptape Cloud.
List Function DeploymentsTool to list all deployments for a specific function.
List FunctionsTool to list all functions with optional pagination.
List Import JobsTool to list import jobs in Griptape Cloud.
List IntegrationsTool to list all integrations.
List Knowledge Base JobsTool to list knowledge base jobs for a specific knowledge base.
List Knowledge Base QueriesTool to list all queries made to a specific Griptape Cloud knowledge base.
List Knowledge BasesTool to list all knowledge bases.
List Knowledge Base SearchesTool to list all searches performed on a specific knowledge base.
List LibrariesTool to list all libraries in Griptape Cloud.
List Model Auth ConfigsTool to list all model authentication configurations with optional pagination.
List ModelsTool to list all models in Griptape Cloud.
List Organization API KeysTool to list all API keys in a specific organization.
List OrganizationsTool to list all organizations in Griptape Cloud.
List Retriever ComponentsTool to list all retriever components in Griptape Cloud.
List RetrieversTool to list all retrievers in Griptape Cloud.
List RulesTool to list all rules in Griptape Cloud with optional pagination and filtering.
List SecretsTool to list all secrets in Griptape Cloud.
List Structure DeploymentsTool to list all deployments for a specific structure.
List Structure RunsTool to list all runs for a specific structure with optional pagination and status filtering.
List StructuresTool to list all structures in Griptape Cloud.
List Thread MessagesTool to list all messages in a specific thread.
List ThreadsTool to list all threads.
List Tool DeploymentsTool to list all deployments for a specific tool.
List Tool RunsTool to list all runs for a specific tool with optional pagination and status filtering.
List UsersTool to list all users in Griptape Cloud.
Query knowledge basePerforms semantic search against a Griptape Cloud knowledge base using natural language.
Query RetrieverTool to query a retriever in Griptape Cloud with a natural-language query.
Ruleset CreationCreates a new ruleset in Griptape Cloud.
Search Knowledge BaseSearches a Griptape Cloud Knowledge Base with a natural-language query and returns a synthesized answer.
Create ToolCreate a new tool resource in Griptape Cloud.
Get Tool Deployment StatusTool to retrieve status of a specific tool deployment.
List ToolsTool to list all tools.
Update AssistantTool to update an existing assistant's configuration.
Update BucketTool to update a bucket's properties by its ID.
Update Data ConnectorTool to update a data connector's configuration in Griptape Cloud.
Update FunctionTool to update an existing function's configuration.
Update IntegrationTool to update an existing integration's configuration.
Update Knowledge BaseTool to update a knowledge base's configuration in Griptape Cloud.
Update LibraryTool to update an existing library's configuration in Griptape Cloud.
Update MessageTool to update a message's input, output, and metadata by its ID.
Update Model ConfigurationTool to update a model configuration's properties by its ID.
Update Model Auth ConfigTool to update an existing model auth config's properties.
Update OrganizationTool to update an organization's properties by its ID.
Update RetrieverTool to update an existing retriever's configuration in Griptape Cloud.
Update Retriever ComponentTool to update a retriever component's configuration by its ID.
Update RuleTool to update an existing rule's configuration.
Update RulesetTool to update an existing ruleset's configuration.
Update SecretTool to update a secret's properties by its ID.
Update StructureTool to update an existing structure's configuration.
Update ThreadTool to update an existing thread's configuration.
Update ToolTool to update an existing tool's configuration.

What is the Composio tool router, and how does it fit here?

What is Composio SDK?

Composio's Composio SDK helps agents find the right tools for a task at runtime. You can plug in multiple toolkits (like Gmail, HubSpot, and GitHub), and the agent will identify the relevant app and action to complete multi-step workflows. This can reduce token usage and improve the reliability of tool calls. Read more here: Getting started with Composio SDK

The tool router generates a secure MCP URL that your agents can access to perform actions.

How the Composio SDK works

The Composio SDK follows a three-phase workflow:

  1. Discovery: Searches for tools matching your task and returns relevant toolkits with their details.
  2. Authentication: Checks for active connections. If missing, creates an auth config and returns a connection URL via Auth Link.
  3. Execution: Executes the action using the authenticated connection.

Step-by-step Guide

Prerequisites

Before starting, make sure you have:
  • Python 3.9 or higher
  • A Composio account with an active API key
  • Basic familiarity with Python and async programming

Getting API Keys for OpenAI and Composio

OpenAI API Key
  • Go to the OpenAI dashboard and create an API key. You'll need credits to use the models, or you can connect to another model provider.
  • Keep the API key safe.
Composio API Key
  • Log in to the Composio dashboard.
  • Navigate to your API settings and generate a new API key.
  • Store this key securely as you'll need it for authentication.

Install dependencies

bash
pip install composio pydantic-ai python-dotenv

Install the required libraries.

What's happening:

  • composio connects your agent to external SaaS tools like Griptape
  • pydantic-ai lets you create structured AI agents with tool support
  • python-dotenv loads your environment variables securely from a .env file

Set up environment variables

bash
COMPOSIO_API_KEY=your_composio_api_key_here
USER_ID=your_user_id_here
OPENAI_API_KEY=your_openai_api_key

Create a .env file in your project root.

What's happening:

  • COMPOSIO_API_KEY authenticates your agent to Composio's API
  • USER_ID associates your session with your account for secure tool access
  • OPENAI_API_KEY to access OpenAI LLMs

Import dependencies

python
import asyncio
import os
from dotenv import load_dotenv
from composio import Composio
from pydantic_ai import Agent
from pydantic_ai.mcp import MCPServerStreamableHTTP

load_dotenv()
What's happening:
  • We load environment variables and import required modules
  • Composio manages connections to Griptape
  • MCPServerStreamableHTTP connects to the Griptape MCP server endpoint
  • Agent from Pydantic AI lets you define and run the AI assistant

Create a Tool Router Session

python
async def main():
    api_key = os.getenv("COMPOSIO_API_KEY")
    user_id = os.getenv("USER_ID")
    if not api_key or not user_id:
        raise RuntimeError("Set COMPOSIO_API_KEY and USER_ID in your environment")

    # Create a Composio Tool Router session for Griptape
    composio = Composio(api_key=api_key)
    session = composio.create(
        user_id=user_id,
        toolkits=["griptape"],
    )
    url = session.mcp.url
    if not url:
        raise ValueError("Composio session did not return an MCP URL")
What's happening:
  • We're creating a Tool Router session that gives your agent access to Griptape tools
  • The create method takes the user ID and specifies which toolkits should be available
  • The returned session.mcp.url is the MCP server URL that your agent will use

Initialize the Pydantic AI Agent

python
# Attach the MCP server to a Pydantic AI Agent
griptape_mcp = MCPServerStreamableHTTP(url, headers={"x-api-key": COMPOSIO_API_KEY})
agent = Agent(
    "openai:gpt-5",
    toolsets=[griptape_mcp],
    instructions=(
        "You are a Griptape assistant. Use Griptape tools to help users "
        "with their requests. Ask clarifying questions when needed."
    ),
)
What's happening:
  • The MCP client connects to the Griptape endpoint
  • The agent uses GPT-5 to interpret user commands and perform Griptape operations
  • The instructions field defines the agent's role and behavior

Build the chat interface

python
# Simple REPL with message history
history = []
print("Chat started! Type 'exit' or 'quit' to end.\n")
print("Try asking the agent to help you with Griptape.\n")

while True:
    user_input = input("You: ").strip()
    if user_input.lower() in {"exit", "quit", "bye"}:
        print("\nGoodbye!")
        break
    if not user_input:
        continue

    print("\nAgent is thinking...\n", flush=True)

    async with agent.run_stream(user_input, message_history=history) as stream_result:
        collected_text = ""
        async for chunk in stream_result.stream_output():
            text_piece = None
            if isinstance(chunk, str):
                text_piece = chunk
            elif hasattr(chunk, "delta") and isinstance(chunk.delta, str):
                text_piece = chunk.delta
            elif hasattr(chunk, "text"):
                text_piece = chunk.text
            if text_piece:
                collected_text += text_piece
        result = stream_result

    print(f"Agent: {collected_text}\n")
    history = result.all_messages()
What's happening:
  • The agent reads input from the terminal and streams its response
  • Griptape API calls happen automatically under the hood
  • The model keeps conversation history to maintain context across turns

Run the application

python
if __name__ == "__main__":
    asyncio.run(main())
What's happening:
  • The asyncio loop launches the agent and keeps it running until you exit

Complete Code

Here's the complete code to get you started with Griptape and Pydantic AI:

python
import asyncio
import os
from dotenv import load_dotenv
from composio import Composio
from pydantic_ai import Agent
from pydantic_ai.mcp import MCPServerStreamableHTTP

load_dotenv()

async def main():
    api_key = os.getenv("COMPOSIO_API_KEY")
    user_id = os.getenv("USER_ID")
    if not api_key or not user_id:
        raise RuntimeError("Set COMPOSIO_API_KEY and USER_ID in your environment")

    # Create a Composio Tool Router session for Griptape
    composio = Composio(api_key=api_key)
    session = composio.create(
        user_id=user_id,
        toolkits=["griptape"],
    )
    url = session.mcp.url
    if not url:
        raise ValueError("Composio session did not return an MCP URL")

    # Attach the MCP server to a Pydantic AI Agent
    griptape_mcp = MCPServerStreamableHTTP(url, headers={"x-api-key": COMPOSIO_API_KEY})
    agent = Agent(
        "openai:gpt-5",
        toolsets=[griptape_mcp],
        instructions=(
            "You are a Griptape assistant. Use Griptape tools to help users "
            "with their requests. Ask clarifying questions when needed."
        ),
    )

    # Simple REPL with message history
    history = []
    print("Chat started! Type 'exit' or 'quit' to end.\n")
    print("Try asking the agent to help you with Griptape.\n")

    while True:
        user_input = input("You: ").strip()
        if user_input.lower() in {"exit", "quit", "bye"}:
            print("\nGoodbye!")
            break
        if not user_input:
            continue

        print("\nAgent is thinking...\n", flush=True)

        async with agent.run_stream(user_input, message_history=history) as stream_result:
            collected_text = ""
            async for chunk in stream_result.stream_output():
                text_piece = None
                if isinstance(chunk, str):
                    text_piece = chunk
                elif hasattr(chunk, "delta") and isinstance(chunk.delta, str):
                    text_piece = chunk.delta
                elif hasattr(chunk, "text"):
                    text_piece = chunk.text
                if text_piece:
                    collected_text += text_piece
            result = stream_result

        print(f"Agent: {collected_text}\n")
        history = result.all_messages()

if __name__ == "__main__":
    asyncio.run(main())

Conclusion

You've built a Pydantic AI agent that can interact with Griptape through Composio's Tool Router. With this setup, your agent can perform real Griptape actions through natural language. You can extend this further by:
  • Adding other toolkits like Gmail, HubSpot, or Salesforce
  • Building a web-based chat interface around this agent
  • Using multiple MCP endpoints to enable cross-app workflows (for example, Gmail + Griptape for workflow automation)
This architecture makes your AI agent "agent-native", able to securely use APIs in a unified, composable way without custom integrations.

How to build Griptape MCP Agent with another framework

OpenAI Agents SDK logo

OpenAI Agents SDK

Use Griptape MCP with OpenAI Agents SDK

Claude Agent SDK logo

Claude Agent SDK

Use Griptape MCP with Claude Agent SDK

Claude Code logo

Claude Code

Use Griptape MCP with Claude Code

Claude Cowork logo

Claude Cowork

Use Griptape MCP with Claude Cowork

Codex logo

Codex

Use Griptape MCP with Codex

OpenClaw logo

OpenClaw

Use Griptape MCP with OpenClaw

Hermes logo

Hermes

Use Griptape MCP with Hermes

CLI logo

CLI

Use Griptape MCP with CLI

Google ADK logo

Google ADK

Use Griptape MCP with Google ADK

LangChain logo

LangChain

Use Griptape MCP with LangChain

Vercel AI SDK logo

Vercel AI SDK

Use Griptape MCP with Vercel AI SDK

Mastra AI logo

Mastra AI

Use Griptape MCP with Mastra AI

LlamaIndex logo

LlamaIndex

Use Griptape MCP with LlamaIndex

CrewAI logo

CrewAI

Use Griptape MCP with CrewAI

FAQ

What are the differences in Tool Router MCP and Griptape MCP?

With a standalone Griptape MCP server, the agents and LLMs can only access a fixed set of Griptape tools tied to that server. However, with the Composio Tool Router, agents can dynamically load tools from Griptape and many other apps based on the task at hand, all through a single MCP endpoint.

Can I use Tool Router MCP with Pydantic AI?

Yes, you can. Pydantic AI fully supports MCP integration. You get structured tool calling, message history handling, and model orchestration while Tool Router takes care of discovering and serving the right Griptape tools.

Can I manage the permissions and scopes for Griptape while using Tool Router?

Yes, absolutely. You can configure which Griptape scopes and actions are allowed when connecting your account to Composio. You can also bring your own OAuth credentials or API configuration so you keep full control over what the agent can do.

How safe is my data with Composio Tool Router?

All sensitive data such as tokens, keys, and configuration is fully encrypted at rest and in transit. Composio is SOC 2 Type 2 compliant and follows strict security practices so your Griptape data and credentials are handled as safely as possible.

Used by agents from

Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai
Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai
Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai

Never worry about agent reliability

We handle tool reliability, observability, and security so you never have to second-guess an agent action.

Get started for freeGet a demo↗