How to integrate Griptape MCP with LlamaIndex

Trusted by
AWS
Glean
Zoom
Airtable

30 min · no commitment · see it on your stack

Griptape logo
LlamaIndex logo
divider

Introduction

This guide walks you through connecting Griptape to LlamaIndex using the Composio tool router. By the end, you'll have a working Griptape agent that can create a new assistant named 'dochelper', list all assistants available in your workspace, start a run for assistant 'codegenpro' with input data through natural language commands.

This guide will help you understand how to give your LlamaIndex agent real control over a Griptape account through Composio's Griptape MCP server.

Before we dive in, let's take a quick look at the key ideas and tools involved.

Also integrate Griptape with

TL;DR

Here's what you'll learn:
  • Set your OpenAI and Composio API keys
  • Install LlamaIndex and Composio packages
  • Create a Composio Tool Router session for Griptape
  • Connect LlamaIndex to the Griptape MCP server
  • Build a Griptape-powered agent using LlamaIndex
  • Interact with Griptape through natural language

What is LlamaIndex?

LlamaIndex is a data framework for building LLM applications. It provides tools for connecting LLMs to external data sources and services through agents and tools.

Key features include:

  • ReAct Agent: Reasoning and acting pattern for tool-using agents
  • MCP Tools: Native support for Model Context Protocol
  • Context Management: Maintain conversation context across interactions
  • Async Support: Built for async/await patterns

What is the Griptape MCP server, and what's possible with it?

The Griptape MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your Griptape account. It provides structured and secure access to your Griptape platform, so your agent can create assistants, launch and monitor AI runs, retrieve logs, and analyze results automatically on your behalf.

  • Automated assistant creation and management: Easily direct your agent to create new assistants or list existing ones, making it simple to manage your AI resources in Griptape Cloud.
  • Launching and controlling assistant runs: Let your agent start new assistant runs, cancel ongoing executions, or fetch the status of any run for streamlined AI workflow management.
  • Real-time monitoring of assistant activities: Have your agent stream live run events, monitor progress, or retrieve detailed logs to keep tabs on every step of your generative AI processes.
  • Error handling and diagnostics: Ask your agent to fetch detailed error reports for failed runs, helping you troubleshoot and resolve issues quickly and efficiently.
  • Result retrieval and historical analysis: Automatically pull final outputs from completed runs and review historical execution data, empowering you to analyze and improve your generative AI pipelines over time.

Supported Tools & Triggers

Tools
Assistant CreationTool to create a new assistant.
List AssistantsTool to list all assistants.
Cancel Assistant RunTool to cancel an ongoing assistant run.
Assistant Run CreationCreates a new assistant run to execute a conversation turn with a Griptape Cloud assistant.
Get Assistant Run Error DetailsTool to fetch detailed error information for a specific assistant run.
List Assistant RunsTool to list all runs for a given assistant.
Assistant Run Logs RetrievalRetrieve the complete execution logs for an assistant run in Griptape Cloud.
Retrieve Assistant RunTool to retrieve an assistant run's status and details.
Retry Assistant RunTool to attempt retrying a failed assistant run.
Cancel Data JobTool to cancel a running or queued data job.
Create BucketTool to create a new bucket in Griptape Cloud.
Create Bucket AssetTool to create a new asset in a Griptape Cloud bucket.
Create Data ConnectorTool to create a new data connector in Griptape Cloud.
Create Data Connector JobTool to create a data job for a data connector in Griptape Cloud.
Create Export JobTool to create a new export job in Griptape Cloud.
Create FunctionTool to create a new function in Griptape Cloud.
Create Function DeploymentTool to create a new deployment for a function from a code source.
Create Import JobTool to create a new import job in Griptape Cloud.
Create IntegrationTool to create a new integration in Griptape Cloud.
Create Knowledge BaseTool to create a new knowledge base in Griptape Cloud.
Create Knowledge Base JobTool to create a knowledge base job for ingesting data into a knowledge base.
Create LibraryTool to create a new library in Griptape Cloud.
Create Model ConfigurationTool to create a new model configuration in Griptape Cloud.
Create Model Auth ConfigTool to create a model authentication configuration in Griptape Cloud.
Create Organization API KeyTool to create a new API key for a specific organization.
Create RetrieverTool to create a new retriever in Griptape Cloud.
Create RuleTool to create a new rule in Griptape Cloud.
Create SecretTool to create a new secret in Griptape Cloud.
Create StructureTool to create a new structure in Griptape Cloud.
Create Structure DeploymentTool to create a new deployment for a structure.
Create ThreadTool to create a new thread in Griptape Cloud.
Create Thread MessageTool to create a new message in a specific thread.
Create Tool DeploymentCreate a new deployment for a tool from a GitHub repository.
Delete API KeyTool to delete an API key by ID.
Delete AssistantTool to delete an assistant by ID.
Delete BucketTool to delete a bucket by ID.
Delete Bucket AssetTool to delete a specific asset from a Griptape Cloud bucket.
Delete Data ConnectorTool to delete a data connector.
Delete FunctionTool to delete a function from Griptape Cloud.
Delete IntegrationTool to delete an integration by ID.
Delete Knowledge BaseTool to delete a Knowledge Base from Griptape Cloud.
Delete LibraryTool to delete a library from Griptape Cloud.
Delete MessageTool to delete a message by its ID.
Delete Model ConfigurationTool to delete a model configuration from Griptape Cloud.
Delete Model Auth ConfigTool to delete a model auth config by ID.
Delete RuleTool to delete a rule by its ID.
Delete RulesetTool to permanently delete a ruleset from Griptape Cloud by its ID.
Delete SecretTool to delete a secret from Griptape Cloud.
Delete StructureTool to delete a structure from Griptape Cloud.
Delete ThreadTool to delete a thread by its ID.
Delete ToolTool to delete a tool from Griptape Cloud.
Get API KeyTool to retrieve an API key's details.
Get AssistantTool to retrieve a specific assistant's details by ID.
Get Billing Management URLTool to retrieve the billing management portal URL.
Get BucketTool to retrieve a bucket's details by its ID.
Get Bucket AssetTool to retrieve a specific asset from a Griptape Cloud bucket.
Get Bucket Asset URLTool to generate a signed URL for accessing or uploading bucket assets.
Get ConfigurationTool to retrieve Griptape Cloud configuration.
Get Credits BalanceTool to retrieve the current credits balance.
Get Data ConnectorTool to retrieve a data connector's configuration and details from Griptape Cloud.
Get Data JobTool to retrieve a data job's status and details by its ID.
Get Export JobTool to retrieve an export job by ID.
Get FunctionTool to retrieve a function's details.
Get Import JobTool to retrieve an import job's status and details.
Get IntegrationTool to retrieve a specific integration's details by ID.
Get Knowledge BaseTool to retrieve a knowledge base's configuration and details from Griptape Cloud.
Get Knowledge Base JobTool to retrieve a knowledge base job's status and details by its ID.
Get Knowledge Base SearchTool to retrieve details of a specific knowledge base search by its ID.
Get LibraryTool to retrieve a specific library's details by ID.
Get MessageTool to retrieve a specific message's details by ID.
Get Model ConfigurationTool to retrieve a model configuration's details by its ID.
Get Model Auth ConfigTool to retrieve a model auth config by ID.
Get OrganizationTool to retrieve an organization's details by its ID.
Get RetrieverTool to retrieve a retriever's details by its ID.
Get Retriever ComponentTool to retrieve a retriever component's details by its ID.
Get RuleTool to retrieve a specific rule's details by ID.
Get RulesetTool to retrieve a specific ruleset's details by ID.
Get Ruleset by AliasRetrieve a ruleset from Griptape Cloud by its unique alias identifier.
Get SecretTool to retrieve a secret's details from Griptape Cloud.
Get StructureTool to retrieve a structure's configuration and details from Griptape Cloud.
Get Structures DashboardTool to retrieve dashboard metrics for structures.
Get ThreadTool to retrieve a specific thread's details by ID.
Get ToolTool to retrieve a specific tool's details by ID.
Get UsageTool to retrieve current usage statistics.
Get UserTool to retrieve a user's details by their ID.
List Assistant Run EventsTool to list events for an assistant run with pagination support.
List Bucket AssetsTool to list assets in a bucket.
List BucketsTool to list all buckets in Griptape Cloud.
List ConnectionsTool to list all connections.
List Data ConnectorsTool to list all data connectors.
List Embedding DriversTool to list available embedding drivers.
List Export JobsTool to list export jobs from Griptape Cloud.
List Function DeploymentsTool to list all deployments for a specific function.
List FunctionsTool to list all functions with optional pagination.
List Import JobsTool to list import jobs in Griptape Cloud.
List IntegrationsTool to list all integrations.
List Knowledge Base JobsTool to list knowledge base jobs for a specific knowledge base.
List Knowledge Base QueriesTool to list all queries made to a specific Griptape Cloud knowledge base.
List Knowledge BasesTool to list all knowledge bases.
List Knowledge Base SearchesTool to list all searches performed on a specific knowledge base.
List LibrariesTool to list all libraries in Griptape Cloud.
List Model Auth ConfigsTool to list all model authentication configurations with optional pagination.
List ModelsTool to list all models in Griptape Cloud.
List Organization API KeysTool to list all API keys in a specific organization.
List OrganizationsTool to list all organizations in Griptape Cloud.
List Retriever ComponentsTool to list all retriever components in Griptape Cloud.
List RetrieversTool to list all retrievers in Griptape Cloud.
List RulesTool to list all rules in Griptape Cloud with optional pagination and filtering.
List SecretsTool to list all secrets in Griptape Cloud.
List Structure DeploymentsTool to list all deployments for a specific structure.
List Structure RunsTool to list all runs for a specific structure with optional pagination and status filtering.
List StructuresTool to list all structures in Griptape Cloud.
List Thread MessagesTool to list all messages in a specific thread.
List ThreadsTool to list all threads.
List Tool DeploymentsTool to list all deployments for a specific tool.
List Tool RunsTool to list all runs for a specific tool with optional pagination and status filtering.
List UsersTool to list all users in Griptape Cloud.
Query knowledge basePerforms semantic search against a Griptape Cloud knowledge base using natural language.
Query RetrieverTool to query a retriever in Griptape Cloud with a natural-language query.
Ruleset CreationCreates a new ruleset in Griptape Cloud.
Search Knowledge BaseSearches a Griptape Cloud Knowledge Base with a natural-language query and returns a synthesized answer.
Create ToolCreate a new tool resource in Griptape Cloud.
Get Tool Deployment StatusTool to retrieve status of a specific tool deployment.
List ToolsTool to list all tools.
Update AssistantTool to update an existing assistant's configuration.
Update BucketTool to update a bucket's properties by its ID.
Update Data ConnectorTool to update a data connector's configuration in Griptape Cloud.
Update FunctionTool to update an existing function's configuration.
Update IntegrationTool to update an existing integration's configuration.
Update Knowledge BaseTool to update a knowledge base's configuration in Griptape Cloud.
Update LibraryTool to update an existing library's configuration in Griptape Cloud.
Update MessageTool to update a message's input, output, and metadata by its ID.
Update Model ConfigurationTool to update a model configuration's properties by its ID.
Update Model Auth ConfigTool to update an existing model auth config's properties.
Update OrganizationTool to update an organization's properties by its ID.
Update RetrieverTool to update an existing retriever's configuration in Griptape Cloud.
Update Retriever ComponentTool to update a retriever component's configuration by its ID.
Update RuleTool to update an existing rule's configuration.
Update RulesetTool to update an existing ruleset's configuration.
Update SecretTool to update a secret's properties by its ID.
Update StructureTool to update an existing structure's configuration.
Update ThreadTool to update an existing thread's configuration.
Update ToolTool to update an existing tool's configuration.

What is the Composio tool router, and how does it fit here?

What is Composio SDK?

Composio's Composio SDK helps agents find the right tools for a task at runtime. You can plug in multiple toolkits (like Gmail, HubSpot, and GitHub), and the agent will identify the relevant app and action to complete multi-step workflows. This can reduce token usage and improve the reliability of tool calls. Read more here: Getting started with Composio SDK

The tool router generates a secure MCP URL that your agents can access to perform actions.

How the Composio SDK works

The Composio SDK follows a three-phase workflow:

  1. Discovery: Searches for tools matching your task and returns relevant toolkits with their details.
  2. Authentication: Checks for active connections. If missing, creates an auth config and returns a connection URL via Auth Link.
  3. Execution: Executes the action using the authenticated connection.

Step-by-step Guide

Prerequisites

Before you begin, make sure you have:
  • Python 3.8/Node 16 or higher installed
  • A Composio account with the API key
  • An OpenAI API key
  • A Griptape account and project
  • Basic familiarity with async Python/Typescript

Getting API Keys for OpenAI, Composio, and Griptape

OpenAI API key (OPENAI_API_KEY)
  • Go to the OpenAI dashboard
  • Create an API key if you don't have one
  • Assign it to OPENAI_API_KEY in .env
Composio API key and user ID
  • Log into the Composio dashboard
  • Copy your API key from Settings
    • Use this as COMPOSIO_API_KEY
  • Pick a stable user identifier (email or ID)
    • Use this as COMPOSIO_USER_ID

Installing dependencies

pip install composio-llamaindex llama-index llama-index-llms-openai llama-index-tools-mcp python-dotenv

Create a new Python project and install the necessary dependencies:

  • composio-llamaindex: Composio's LlamaIndex integration
  • llama-index: Core LlamaIndex framework
  • llama-index-llms-openai: OpenAI LLM integration
  • llama-index-tools-mcp: MCP client for LlamaIndex
  • python-dotenv: Environment variable management

Set environment variables

bash
OPENAI_API_KEY=your-openai-api-key
COMPOSIO_API_KEY=your-composio-api-key
COMPOSIO_USER_ID=your-user-id

Create a .env file in your project root:

These credentials will be used to:

  • Authenticate with OpenAI's GPT-5 model
  • Connect to Composio's Tool Router
  • Identify your Composio user session for Griptape access

Import modules

import asyncio
import os
import dotenv

from composio import Composio
from composio_llamaindex import LlamaIndexProvider
from llama_index.core.agent.workflow import ReActAgent
from llama_index.core.workflow import Context
from llama_index.llms.openai import OpenAI
from llama_index.tools.mcp import BasicMCPClient, McpToolSpec

dotenv.load_dotenv()

Create a new file called griptape_llamaindex_agent.py and import the required modules:

Key imports:

  • asyncio: For async/await support
  • Composio: Main client for Composio services
  • LlamaIndexProvider: Adapts Composio tools for LlamaIndex
  • ReActAgent: LlamaIndex's reasoning and action agent
  • BasicMCPClient: Connects to MCP endpoints
  • McpToolSpec: Converts MCP tools to LlamaIndex format

Load environment variables and initialize Composio

OPENAI_API_KEY = os.getenv("OPENAI_API_KEY")
COMPOSIO_API_KEY = os.getenv("COMPOSIO_API_KEY")
COMPOSIO_USER_ID = os.getenv("COMPOSIO_USER_ID")

if not OPENAI_API_KEY:
    raise ValueError("OPENAI_API_KEY is not set in the environment")
if not COMPOSIO_API_KEY:
    raise ValueError("COMPOSIO_API_KEY is not set in the environment")
if not COMPOSIO_USER_ID:
    raise ValueError("COMPOSIO_USER_ID is not set in the environment")

What's happening:

This ensures missing credentials cause early, clear errors before the agent attempts to initialise.

Create a Tool Router session and build the agent function

async def build_agent() -> ReActAgent:
    composio_client = Composio(
        api_key=COMPOSIO_API_KEY,
        provider=LlamaIndexProvider(),
    )

    session = composio_client.create(
        user_id=COMPOSIO_USER_ID,
        toolkits=["griptape"],
    )

    mcp_url = session.mcp.url
    print(f"Composio MCP URL: {mcp_url}")

    mcp_client = BasicMCPClient(mcp_url, headers={"x-api-key": COMPOSIO_API_KEY})
    mcp_tool_spec = McpToolSpec(client=mcp_client)
    tools = await mcp_tool_spec.to_tool_list_async()

    llm = OpenAI(model="gpt-5")

    description = "An agent that uses Composio Tool Router MCP tools to perform Griptape actions."
    system_prompt = """
    You are a helpful assistant connected to Composio Tool Router.
    Use the available tools to answer user queries and perform Griptape actions.
    """
    return ReActAgent(tools=tools, llm=llm, description=description, system_prompt=system_prompt, verbose=True)

What's happening here:

  • We create a Composio client using your API key and configure it with the LlamaIndex provider
  • We then create a tool router MCP session for your user, specifying the toolkits we want to use (in this case, griptape)
  • The session returns an MCP HTTP endpoint URL that acts as a gateway to all your configured tools
  • LlamaIndex will connect to this endpoint to dynamically discover and use the available Griptape tools.
  • The MCP tools are mapped to LlamaIndex-compatible tools and plug them into the Agent.

Create an interactive chat loop

async def chat_loop(agent: ReActAgent) -> None:
    ctx = Context(agent)
    print("Type 'quit', 'exit', or Ctrl+C to stop.")

    while True:
        try:
            user_input = input("\nYou: ").strip()
        except (KeyboardInterrupt, EOFError):
            print("\nBye!")
            break

        if not user_input or user_input.lower() in {"quit", "exit"}:
            print("Bye!")
            break

        try:
            print("Agent: ", end="", flush=True)
            handler = agent.run(user_input, ctx=ctx)

            async for event in handler.stream_events():
                # Stream token-by-token from LLM responses
                if hasattr(event, "delta") and event.delta:
                    print(event.delta, end="", flush=True)
                # Show tool calls as they happen
                elif hasattr(event, "tool_name"):
                    print(f"\n[Using tool: {event.tool_name}]", flush=True)

            # Get final response
            response = await handler
            print()  # Newline after streaming
        except KeyboardInterrupt:
            print("\n[Interrupted]")
            continue
        except Exception as e:
            print(f"\nError: {e}")

What's happening here:

  • We're creating a direct terminal interface to chat with your Griptape database
  • The LLM's responses are streamed to the CLI for faster interaction.
  • The agent uses context to maintain conversation history
  • You can type 'quit' or 'exit' to stop the chat loop gracefully
  • Agent responses and any errors are displayed in a clear, readable format

Define the main entry point

async def main() -> None:
    agent = await build_agent()
    await chat_loop(agent)

if __name__ == "__main__":
    # Handle Ctrl+C gracefully
    signal.signal(signal.SIGINT, lambda s, f: (print("\nBye!"), exit(0)))
    try:
        asyncio.run(main())
    except KeyboardInterrupt:
        print("\nBye!")

What's happening here:

  • We're orchestrating the entire application flow
  • The agent gets built with proper error handling
  • Then we kick off the interactive chat loop so you can start talking to Griptape

Run the agent

npx ts-node llamaindex-agent.ts

When prompted, authenticate and authorise your agent with Griptape, then start asking questions.

Complete Code

Here's the complete code to get you started with Griptape and LlamaIndex:

import asyncio
import os
import signal
import dotenv

from composio import Composio
from composio_llamaindex import LlamaIndexProvider
from llama_index.core.agent.workflow import ReActAgent
from llama_index.core.workflow import Context
from llama_index.llms.openai import OpenAI
from llama_index.tools.mcp import BasicMCPClient, McpToolSpec

dotenv.load_dotenv()

OPENAI_API_KEY = os.getenv("OPENAI_API_KEY")
COMPOSIO_API_KEY = os.getenv("COMPOSIO_API_KEY")
COMPOSIO_USER_ID = os.getenv("COMPOSIO_USER_ID")

if not OPENAI_API_KEY:
    raise ValueError("OPENAI_API_KEY is not set")
if not COMPOSIO_API_KEY:
    raise ValueError("COMPOSIO_API_KEY is not set")
if not COMPOSIO_USER_ID:
    raise ValueError("COMPOSIO_USER_ID is not set")

async def build_agent() -> ReActAgent:
    composio_client = Composio(
        api_key=COMPOSIO_API_KEY,
        provider=LlamaIndexProvider(),
    )

    session = composio_client.create(
        user_id=COMPOSIO_USER_ID,
        toolkits=["griptape"],
    )

    mcp_url = session.mcp.url
    print(f"Composio MCP URL: {mcp_url}")

    mcp_client = BasicMCPClient(mcp_url, headers={"x-api-key": COMPOSIO_API_KEY})
    mcp_tool_spec = McpToolSpec(client=mcp_client)
    tools = await mcp_tool_spec.to_tool_list_async()

    llm = OpenAI(model="gpt-5")
    description = "An agent that uses Composio Tool Router MCP tools to perform Griptape actions."
    system_prompt = """
    You are a helpful assistant connected to Composio Tool Router.
    Use the available tools to answer user queries and perform Griptape actions.
    """
    return ReActAgent(
        tools=tools,
        llm=llm,
        description=description,
        system_prompt=system_prompt,
        verbose=True,
    );

async def chat_loop(agent: ReActAgent) -> None:
    ctx = Context(agent)
    print("Type 'quit', 'exit', or Ctrl+C to stop.")

    while True:
        try:
            user_input = input("\nYou: ").strip()
        except (KeyboardInterrupt, EOFError):
            print("\nBye!")
            break

        if not user_input or user_input.lower() in {"quit", "exit"}:
            print("Bye!")
            break

        try:
            print("Agent: ", end="", flush=True)
            handler = agent.run(user_input, ctx=ctx)

            async for event in handler.stream_events():
                # Stream token-by-token from LLM responses
                if hasattr(event, "delta") and event.delta:
                    print(event.delta, end="", flush=True)
                # Show tool calls as they happen
                elif hasattr(event, "tool_name"):
                    print(f"\n[Using tool: {event.tool_name}]", flush=True)

            # Get final response
            response = await handler
            print()  # Newline after streaming
        except KeyboardInterrupt:
            print("\n[Interrupted]")
            continue
        except Exception as e:
            print(f"\nError: {e}")

async def main() -> None:
    agent = await build_agent()
    await chat_loop(agent)

if __name__ == "__main__":
    # Handle Ctrl+C gracefully
    signal.signal(signal.SIGINT, lambda s, f: (print("\nBye!"), exit(0)))
    try:
        asyncio.run(main())
    except KeyboardInterrupt:
        print("\nBye!")

Conclusion

You've successfully connected Griptape to LlamaIndex through Composio's Tool Router MCP layer. Key takeaways:
  • Tool Router dynamically exposes Griptape tools through an MCP endpoint
  • LlamaIndex's ReActAgent handles reasoning and orchestration; Composio handles integrations
  • The agent becomes more capable without increasing prompt size
  • Async Python provides clean, efficient execution of agent workflows
You can easily extend this to other toolkits like Gmail, Notion, Stripe, GitHub, and more by adding them to the toolkits parameter.

How to build Griptape MCP Agent with another framework

FAQ

What are the differences in Tool Router MCP and Griptape MCP?

With a standalone Griptape MCP server, the agents and LLMs can only access a fixed set of Griptape tools tied to that server. However, with the Composio Tool Router, agents can dynamically load tools from Griptape and many other apps based on the task at hand, all through a single MCP endpoint.

Can I use Tool Router MCP with LlamaIndex?

Yes, you can. LlamaIndex fully supports MCP integration. You get structured tool calling, message history handling, and model orchestration while Tool Router takes care of discovering and serving the right Griptape tools.

Can I manage the permissions and scopes for Griptape while using Tool Router?

Yes, absolutely. You can configure which Griptape scopes and actions are allowed when connecting your account to Composio. You can also bring your own OAuth credentials or API configuration so you keep full control over what the agent can do.

How safe is my data with Composio Tool Router?

All sensitive data such as tokens, keys, and configuration is fully encrypted at rest and in transit. Composio is SOC 2 Type 2 compliant and follows strict security practices so your Griptape data and credentials are handled as safely as possible.

Used by agents from

Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai
Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai
Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai

Never worry about agent reliability

We handle tool reliability, observability, and security so you never have to second-guess an agent action.