How to integrate Griptape MCP with Vercel AI SDK v6

Trusted by
AWS
Glean
Zoom
Airtable

30 min · no commitment · see it on your stack

Griptape logo
Vercel AI SDK logo
divider

Introduction

This guide walks you through connecting Griptape to Vercel AI SDK v6 using the Composio tool router. By the end, you'll have a working Griptape agent that can create a new assistant named 'dochelper', list all assistants available in your workspace, start a run for assistant 'codegenpro' with input data through natural language commands.

This guide will help you understand how to give your Vercel AI SDK agent real control over a Griptape account through Composio's Griptape MCP server.

Before we dive in, let's take a quick look at the key ideas and tools involved.

Also integrate Griptape with

TL;DR

Here's what you'll learn:
  • How to set up and configure a Vercel AI SDK agent with Griptape integration
  • Using Composio's Tool Router to dynamically load and access Griptape tools
  • Creating an MCP client connection using HTTP transport
  • Building an interactive CLI chat interface with conversation history management
  • Handling tool calls and results within the Vercel AI SDK framework

What is Vercel AI SDK?

The Vercel AI SDK is a TypeScript library for building AI-powered applications. It provides tools for creating agents that can use external services and maintain conversation state.

Key features include:

  • streamText: Core function for streaming responses with real-time tool support
  • MCP Client: Built-in support for Model Context Protocol via @ai-sdk/mcp
  • Step Counting: Control multi-step tool execution with stopWhen: stepCountIs()
  • OpenAI Provider: Native integration with OpenAI models

What is the Griptape MCP server, and what's possible with it?

The Griptape MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your Griptape account. It provides structured and secure access to your Griptape platform, so your agent can create assistants, launch and monitor AI runs, retrieve logs, and analyze results automatically on your behalf.

  • Automated assistant creation and management: Easily direct your agent to create new assistants or list existing ones, making it simple to manage your AI resources in Griptape Cloud.
  • Launching and controlling assistant runs: Let your agent start new assistant runs, cancel ongoing executions, or fetch the status of any run for streamlined AI workflow management.
  • Real-time monitoring of assistant activities: Have your agent stream live run events, monitor progress, or retrieve detailed logs to keep tabs on every step of your generative AI processes.
  • Error handling and diagnostics: Ask your agent to fetch detailed error reports for failed runs, helping you troubleshoot and resolve issues quickly and efficiently.
  • Result retrieval and historical analysis: Automatically pull final outputs from completed runs and review historical execution data, empowering you to analyze and improve your generative AI pipelines over time.

Supported Tools & Triggers

Tools
Assistant CreationTool to create a new assistant.
List AssistantsTool to list all assistants.
Cancel Assistant RunTool to cancel an ongoing assistant run.
Assistant Run CreationCreates a new assistant run to execute a conversation turn with a Griptape Cloud assistant.
Get Assistant Run Error DetailsTool to fetch detailed error information for a specific assistant run.
List Assistant RunsTool to list all runs for a given assistant.
Assistant Run Logs RetrievalRetrieve the complete execution logs for an assistant run in Griptape Cloud.
Retrieve Assistant RunTool to retrieve an assistant run's status and details.
Retry Assistant RunTool to attempt retrying a failed assistant run.
Cancel Data JobTool to cancel a running or queued data job.
Create BucketTool to create a new bucket in Griptape Cloud.
Create Bucket AssetTool to create a new asset in a Griptape Cloud bucket.
Create Data ConnectorTool to create a new data connector in Griptape Cloud.
Create Data Connector JobTool to create a data job for a data connector in Griptape Cloud.
Create Export JobTool to create a new export job in Griptape Cloud.
Create FunctionTool to create a new function in Griptape Cloud.
Create Function DeploymentTool to create a new deployment for a function from a code source.
Create Import JobTool to create a new import job in Griptape Cloud.
Create IntegrationTool to create a new integration in Griptape Cloud.
Create Knowledge BaseTool to create a new knowledge base in Griptape Cloud.
Create Knowledge Base JobTool to create a knowledge base job for ingesting data into a knowledge base.
Create LibraryTool to create a new library in Griptape Cloud.
Create Model ConfigurationTool to create a new model configuration in Griptape Cloud.
Create Model Auth ConfigTool to create a model authentication configuration in Griptape Cloud.
Create Organization API KeyTool to create a new API key for a specific organization.
Create RetrieverTool to create a new retriever in Griptape Cloud.
Create RuleTool to create a new rule in Griptape Cloud.
Create SecretTool to create a new secret in Griptape Cloud.
Create StructureTool to create a new structure in Griptape Cloud.
Create Structure DeploymentTool to create a new deployment for a structure.
Create ThreadTool to create a new thread in Griptape Cloud.
Create Thread MessageTool to create a new message in a specific thread.
Create Tool DeploymentCreate a new deployment for a tool from a GitHub repository.
Delete API KeyTool to delete an API key by ID.
Delete AssistantTool to delete an assistant by ID.
Delete BucketTool to delete a bucket by ID.
Delete Bucket AssetTool to delete a specific asset from a Griptape Cloud bucket.
Delete Data ConnectorTool to delete a data connector.
Delete FunctionTool to delete a function from Griptape Cloud.
Delete IntegrationTool to delete an integration by ID.
Delete Knowledge BaseTool to delete a Knowledge Base from Griptape Cloud.
Delete LibraryTool to delete a library from Griptape Cloud.
Delete MessageTool to delete a message by its ID.
Delete Model ConfigurationTool to delete a model configuration from Griptape Cloud.
Delete Model Auth ConfigTool to delete a model auth config by ID.
Delete RuleTool to delete a rule by its ID.
Delete RulesetTool to permanently delete a ruleset from Griptape Cloud by its ID.
Delete SecretTool to delete a secret from Griptape Cloud.
Delete StructureTool to delete a structure from Griptape Cloud.
Delete ThreadTool to delete a thread by its ID.
Delete ToolTool to delete a tool from Griptape Cloud.
Get API KeyTool to retrieve an API key's details.
Get AssistantTool to retrieve a specific assistant's details by ID.
Get Billing Management URLTool to retrieve the billing management portal URL.
Get BucketTool to retrieve a bucket's details by its ID.
Get Bucket AssetTool to retrieve a specific asset from a Griptape Cloud bucket.
Get Bucket Asset URLTool to generate a signed URL for accessing or uploading bucket assets.
Get ConfigurationTool to retrieve Griptape Cloud configuration.
Get Credits BalanceTool to retrieve the current credits balance.
Get Data ConnectorTool to retrieve a data connector's configuration and details from Griptape Cloud.
Get Data JobTool to retrieve a data job's status and details by its ID.
Get Export JobTool to retrieve an export job by ID.
Get FunctionTool to retrieve a function's details.
Get Import JobTool to retrieve an import job's status and details.
Get IntegrationTool to retrieve a specific integration's details by ID.
Get Knowledge BaseTool to retrieve a knowledge base's configuration and details from Griptape Cloud.
Get Knowledge Base JobTool to retrieve a knowledge base job's status and details by its ID.
Get Knowledge Base SearchTool to retrieve details of a specific knowledge base search by its ID.
Get LibraryTool to retrieve a specific library's details by ID.
Get MessageTool to retrieve a specific message's details by ID.
Get Model ConfigurationTool to retrieve a model configuration's details by its ID.
Get Model Auth ConfigTool to retrieve a model auth config by ID.
Get OrganizationTool to retrieve an organization's details by its ID.
Get RetrieverTool to retrieve a retriever's details by its ID.
Get Retriever ComponentTool to retrieve a retriever component's details by its ID.
Get RuleTool to retrieve a specific rule's details by ID.
Get RulesetTool to retrieve a specific ruleset's details by ID.
Get Ruleset by AliasRetrieve a ruleset from Griptape Cloud by its unique alias identifier.
Get SecretTool to retrieve a secret's details from Griptape Cloud.
Get StructureTool to retrieve a structure's configuration and details from Griptape Cloud.
Get Structures DashboardTool to retrieve dashboard metrics for structures.
Get ThreadTool to retrieve a specific thread's details by ID.
Get ToolTool to retrieve a specific tool's details by ID.
Get UsageTool to retrieve current usage statistics.
Get UserTool to retrieve a user's details by their ID.
List Assistant Run EventsTool to list events for an assistant run with pagination support.
List Bucket AssetsTool to list assets in a bucket.
List BucketsTool to list all buckets in Griptape Cloud.
List ConnectionsTool to list all connections.
List Data ConnectorsTool to list all data connectors.
List Embedding DriversTool to list available embedding drivers.
List Export JobsTool to list export jobs from Griptape Cloud.
List Function DeploymentsTool to list all deployments for a specific function.
List FunctionsTool to list all functions with optional pagination.
List Import JobsTool to list import jobs in Griptape Cloud.
List IntegrationsTool to list all integrations.
List Knowledge Base JobsTool to list knowledge base jobs for a specific knowledge base.
List Knowledge Base QueriesTool to list all queries made to a specific Griptape Cloud knowledge base.
List Knowledge BasesTool to list all knowledge bases.
List Knowledge Base SearchesTool to list all searches performed on a specific knowledge base.
List LibrariesTool to list all libraries in Griptape Cloud.
List Model Auth ConfigsTool to list all model authentication configurations with optional pagination.
List ModelsTool to list all models in Griptape Cloud.
List Organization API KeysTool to list all API keys in a specific organization.
List OrganizationsTool to list all organizations in Griptape Cloud.
List Retriever ComponentsTool to list all retriever components in Griptape Cloud.
List RetrieversTool to list all retrievers in Griptape Cloud.
List RulesTool to list all rules in Griptape Cloud with optional pagination and filtering.
List SecretsTool to list all secrets in Griptape Cloud.
List Structure DeploymentsTool to list all deployments for a specific structure.
List Structure RunsTool to list all runs for a specific structure with optional pagination and status filtering.
List StructuresTool to list all structures in Griptape Cloud.
List Thread MessagesTool to list all messages in a specific thread.
List ThreadsTool to list all threads.
List Tool DeploymentsTool to list all deployments for a specific tool.
List Tool RunsTool to list all runs for a specific tool with optional pagination and status filtering.
List UsersTool to list all users in Griptape Cloud.
Query knowledge basePerforms semantic search against a Griptape Cloud knowledge base using natural language.
Query RetrieverTool to query a retriever in Griptape Cloud with a natural-language query.
Ruleset CreationCreates a new ruleset in Griptape Cloud.
Search Knowledge BaseSearches a Griptape Cloud Knowledge Base with a natural-language query and returns a synthesized answer.
Create ToolCreate a new tool resource in Griptape Cloud.
Get Tool Deployment StatusTool to retrieve status of a specific tool deployment.
List ToolsTool to list all tools.
Update AssistantTool to update an existing assistant's configuration.
Update BucketTool to update a bucket's properties by its ID.
Update Data ConnectorTool to update a data connector's configuration in Griptape Cloud.
Update FunctionTool to update an existing function's configuration.
Update IntegrationTool to update an existing integration's configuration.
Update Knowledge BaseTool to update a knowledge base's configuration in Griptape Cloud.
Update LibraryTool to update an existing library's configuration in Griptape Cloud.
Update MessageTool to update a message's input, output, and metadata by its ID.
Update Model ConfigurationTool to update a model configuration's properties by its ID.
Update Model Auth ConfigTool to update an existing model auth config's properties.
Update OrganizationTool to update an organization's properties by its ID.
Update RetrieverTool to update an existing retriever's configuration in Griptape Cloud.
Update Retriever ComponentTool to update a retriever component's configuration by its ID.
Update RuleTool to update an existing rule's configuration.
Update RulesetTool to update an existing ruleset's configuration.
Update SecretTool to update a secret's properties by its ID.
Update StructureTool to update an existing structure's configuration.
Update ThreadTool to update an existing thread's configuration.
Update ToolTool to update an existing tool's configuration.

What is the Composio tool router, and how does it fit here?

What is Composio SDK?

Composio's Composio SDK helps agents find the right tools for a task at runtime. You can plug in multiple toolkits (like Gmail, HubSpot, and GitHub), and the agent will identify the relevant app and action to complete multi-step workflows. This can reduce token usage and improve the reliability of tool calls. Read more here: Getting started with Composio SDK

The tool router generates a secure MCP URL that your agents can access to perform actions.

How the Composio SDK works

The Composio SDK follows a three-phase workflow:

  1. Discovery: Searches for tools matching your task and returns relevant toolkits with their details.
  2. Authentication: Checks for active connections. If missing, creates an auth config and returns a connection URL via Auth Link.
  3. Execution: Executes the action using the authenticated connection.

Step-by-step Guide

Prerequisites

Before you begin, make sure you have:
  • Node.js and npm installed
  • A Composio account with API key
  • An OpenAI API key

Getting API Keys for OpenAI and Composio

OpenAI API Key
  • Go to the OpenAI dashboard and create an API key. You'll need credits to use the models, or you can connect to another model provider.
  • Keep the API key safe.
Composio API Key
  • Log in to the Composio dashboard.
  • Navigate to your API settings and generate a new API key.
  • Store this key securely as you'll need it for authentication.

Install required dependencies

bash
npm install @ai-sdk/openai @ai-sdk/mcp @composio/core ai dotenv

First, install the necessary packages for your project.

What you're installing:

  • @ai-sdk/openai: Vercel AI SDK's OpenAI provider
  • @ai-sdk/mcp: MCP client for Vercel AI SDK
  • @composio/core: Composio SDK for tool integration
  • ai: Core Vercel AI SDK
  • dotenv: Environment variable management

Set up environment variables

bash
OPENAI_API_KEY=your_openai_api_key_here
COMPOSIO_API_KEY=your_composio_api_key_here
COMPOSIO_USER_ID=your_user_id_here

Create a .env file in your project root.

What's needed:

  • OPENAI_API_KEY: Your OpenAI API key for GPT model access
  • COMPOSIO_API_KEY: Your Composio API key for tool access
  • COMPOSIO_USER_ID: A unique identifier for the user session

Import required modules and validate environment

typescript
import "dotenv/config";
import { openai } from "@ai-sdk/openai";
import { Composio } from "@composio/core";
import * as readline from "readline";
import { streamText, type ModelMessage, stepCountIs } from "ai";
import { createMCPClient } from "@ai-sdk/mcp";

const composioAPIKey = process.env.COMPOSIO_API_KEY;
const composioUserID = process.env.COMPOSIO_USER_ID;

if (!process.env.OPENAI_API_KEY) throw new Error("OPENAI_API_KEY is not set");
if (!composioAPIKey) throw new Error("COMPOSIO_API_KEY is not set");
if (!composioUserID) throw new Error("COMPOSIO_USER_ID is not set");

const composio = new Composio({
  apiKey: composioAPIKey,
});
What's happening:
  • We're importing all necessary libraries including Vercel AI SDK's OpenAI provider and Composio
  • The dotenv/config import automatically loads environment variables
  • The MCP client import enables connection to Composio's tool server

Create Tool Router session and initialize MCP client

typescript
async function main() {
  // Create a tool router session for the user
  const session = await composio.create(composioUserID!, {
    toolkits: ["griptape"],
  });

  const mcpUrl = session.mcp.url;
What's happening:
  • We're creating a Tool Router session that gives your agent access to Griptape tools
  • The create method takes the user ID and specifies which toolkits should be available
  • The returned mcp object contains the URL and authentication headers needed to connect to the MCP server
  • This session provides access to all Griptape-related tools through the MCP protocol

Connect to MCP server and retrieve tools

typescript
const mcpClient = await createMCPClient({
  transport: {
    type: "http",
    url: mcpUrl,
    headers: session.mcp.headers, // Authentication headers for the Composio MCP server
  },
});

const tools = await mcpClient.tools();
What's happening:
  • We're creating an MCP client that connects to our Composio Tool Router session via HTTP
  • The mcp.url provides the endpoint, and mcp.headers contains authentication credentials
  • The type: "http" is important - Composio requires HTTP transport
  • tools() retrieves all available Griptape tools that the agent can use

Initialize conversation and CLI interface

typescript
let messages: ModelMessage[] = [];

console.log("Chat started! Type 'exit' or 'quit' to end the conversation.\n");
console.log(
  "Ask any questions related to griptape, like summarize my last 5 emails, send an email, etc... :)))\n",
);

const rl = readline.createInterface({
  input: process.stdin,
  output: process.stdout,
  prompt: "> ",
});

rl.prompt();
What's happening:
  • We initialize an empty messages array to maintain conversation history
  • A readline interface is created to accept user input from the command line
  • Instructions are displayed to guide the user on how to interact with the agent

Handle user input and stream responses with real-time tool feedback

typescript
rl.on("line", async (userInput: string) => {
  const trimmedInput = userInput.trim();

  if (["exit", "quit", "bye"].includes(trimmedInput.toLowerCase())) {
    console.log("\nGoodbye!");
    rl.close();
    process.exit(0);
  }

  if (!trimmedInput) {
    rl.prompt();
    return;
  }

  messages.push({ role: "user", content: trimmedInput });
  console.log("\nAgent is thinking...\n");

  try {
    const stream = streamText({
      model: openai("gpt-5"),
      messages,
      tools,
      toolChoice: "auto",
      stopWhen: stepCountIs(10),
      onStepFinish: (step) => {
        for (const toolCall of step.toolCalls) {
          console.log(`[Using tool: ${toolCall.toolName}]`);
          }
          if (step.toolCalls.length > 0) {
            console.log(""); // Add space after tool calls
          }
        },
      });

      for await (const chunk of stream.textStream) {
        process.stdout.write(chunk);
      }

      console.log("\n\n---\n");

      // Get final result for message history
      const response = await stream.response;
      if (response?.messages?.length) {
        messages.push(...response.messages);
      }
    } catch (error) {
      console.error("\nAn error occurred while talking to the agent:");
      console.error(error);
      console.log(
        "\nYou can try again or restart the app if it keeps happening.\n",
      );
    } finally {
      rl.prompt();
    }
  });

  rl.on("close", async () => {
    await mcpClient.close();
    console.log("\n👋 Session ended.");
    process.exit(0);
  });
}

main().catch((err) => {
  console.error("Fatal error:", err);
  process.exit(1);
});
What's happening:
  • We use streamText instead of generateText to stream responses in real-time
  • toolChoice: "auto" allows the model to decide when to use Griptape tools
  • stopWhen: stepCountIs(10) allows up to 10 steps for complex multi-tool operations
  • onStepFinish callback displays which tools are being used in real-time
  • We iterate through the text stream to create a typewriter effect as the agent responds
  • The complete response is added to conversation history to maintain context
  • Errors are caught and displayed with helpful retry suggestions

Complete Code

Here's the complete code to get you started with Griptape and Vercel AI SDK:

typescript
import "dotenv/config";
import { openai } from "@ai-sdk/openai";
import { Composio } from "@composio/core";
import * as readline from "readline";
import { streamText, type ModelMessage, stepCountIs } from "ai";
import { createMCPClient } from "@ai-sdk/mcp";

const composioAPIKey = process.env.COMPOSIO_API_KEY;
const composioUserID = process.env.COMPOSIO_USER_ID;

if (!process.env.OPENAI_API_KEY) throw new Error("OPENAI_API_KEY is not set");
if (!composioAPIKey) throw new Error("COMPOSIO_API_KEY is not set");
if (!composioUserID) throw new Error("COMPOSIO_USER_ID is not set");

const composio = new Composio({
  apiKey: composioAPIKey,
});

async function main() {
  // Create a tool router session for the user
  const session = await composio.create(composioUserID!, {
    toolkits: ["griptape"],
  });

  const mcpUrl = session.mcp.url;

  const mcpClient = await createMCPClient({
    transport: {
      type: "http",
      url: mcpUrl,
      headers: session.mcp.headers, // Authentication headers for the Composio MCP server
    },
  });

  const tools = await mcpClient.tools();

  let messages: ModelMessage[] = [];

  console.log("Chat started! Type 'exit' or 'quit' to end the conversation.\n");
  console.log(
    "Ask any questions related to griptape, like summarize my last 5 emails, send an email, etc... :)))\n",
  );

  const rl = readline.createInterface({
    input: process.stdin,
    output: process.stdout,
    prompt: "> ",
  });

  rl.prompt();

  rl.on("line", async (userInput: string) => {
    const trimmedInput = userInput.trim();

    if (["exit", "quit", "bye"].includes(trimmedInput.toLowerCase())) {
      console.log("\nGoodbye!");
      rl.close();
      process.exit(0);
    }

    if (!trimmedInput) {
      rl.prompt();
      return;
    }

    messages.push({ role: "user", content: trimmedInput });
    console.log("\nAgent is thinking...\n");

    try {
      const stream = streamText({
        model: openai("gpt-5"),
        messages,
        tools,
        toolChoice: "auto",
        stopWhen: stepCountIs(10),
        onStepFinish: (step) => {
          for (const toolCall of step.toolCalls) {
            console.log(`[Using tool: ${toolCall.toolName}]`);
          }
          if (step.toolCalls.length > 0) {
            console.log(""); // Add space after tool calls
          }
        },
      });

      for await (const chunk of stream.textStream) {
        process.stdout.write(chunk);
      }

      console.log("\n\n---\n");

      // Get final result for message history
      const response = await stream.response;
      if (response?.messages?.length) {
        messages.push(...response.messages);
      }
    } catch (error) {
      console.error("\nAn error occurred while talking to the agent:");
      console.error(error);
      console.log(
        "\nYou can try again or restart the app if it keeps happening.\n",
      );
    } finally {
      rl.prompt();
    }
  });

  rl.on("close", async () => {
    await mcpClient.close();
    console.log("\n👋 Session ended.");
    process.exit(0);
  });
}

main().catch((err) => {
  console.error("Fatal error:", err);
  process.exit(1);
});

Conclusion

You've successfully built a Griptape agent using the Vercel AI SDK with streaming capabilities! This implementation provides a powerful foundation for building AI applications with natural language interfaces and real-time feedback.

Key features of this implementation:

  • Real-time streaming responses for a better user experience with typewriter effect
  • Live tool execution feedback showing which tools are being used as the agent works
  • Dynamic tool loading through Composio's Tool Router with secure authentication
  • Multi-step tool execution with configurable step limits (up to 10 steps)
  • Comprehensive error handling for robust agent execution
  • Conversation history maintenance for context-aware responses

You can extend this further by adding custom error handling, implementing specific business logic, or integrating additional Composio toolkits to create multi-app workflows.

How to build Griptape MCP Agent with another framework

FAQ

What are the differences in Tool Router MCP and Griptape MCP?

With a standalone Griptape MCP server, the agents and LLMs can only access a fixed set of Griptape tools tied to that server. However, with the Composio Tool Router, agents can dynamically load tools from Griptape and many other apps based on the task at hand, all through a single MCP endpoint.

Can I use Tool Router MCP with Vercel AI SDK v6?

Yes, you can. Vercel AI SDK v6 fully supports MCP integration. You get structured tool calling, message history handling, and model orchestration while Tool Router takes care of discovering and serving the right Griptape tools.

Can I manage the permissions and scopes for Griptape while using Tool Router?

Yes, absolutely. You can configure which Griptape scopes and actions are allowed when connecting your account to Composio. You can also bring your own OAuth credentials or API configuration so you keep full control over what the agent can do.

How safe is my data with Composio Tool Router?

All sensitive data such as tokens, keys, and configuration is fully encrypted at rest and in transit. Composio is SOC 2 Type 2 compliant and follows strict security practices so your Griptape data and credentials are handled as safely as possible.

Used by agents from

Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai
Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai
Context
Letta
glean
HubSpot
Agent.ai
Altera
DataStax
Entelligence
Rolai

Never worry about agent reliability

We handle tool reliability, observability, and security so you never have to second-guess an agent action.