How to connect Vercel AI Gateway MCP with ChatGPT

Connect ChatGPT to Vercel AI Gateway MCP. List available vercel ai models and specs, generate marketing copy with vercel model, and more using natural language, with authentication handled for you.

Vercel AI Gateway logoVercel AI Gateway
Api Key

Vercel AI Gateway is a unified AI model gateway offering model discovery, inference, generation, and usage APIs. It provides a single, consistent API surface to route and scale model workloads across providers.

22 Tools

How to connect Vercel AI Gateway MCP with ChatGPT

ChatGPT can take action across your apps and files, stay with a project for hours, and turn a goal into finished materials like sheets, slides, and docs, not just answers.

In this guide, I will explain the easiest and most secure way to connect your Vercel AI Gateway account to ChatGPT via Composio Connect, so it can discover available models, run inference on prompts, generate text and images, adjust request parameters, and fetch usage metrics through natural language commands without ever putting your account credentials at risk.

Also integrate Vercel AI Gateway with

Why use Composio over default connectors?

  • Apps with read and write access. Default connectors mostly can read your data. Composio's Vercel AI Gateway integration lets ChatGPT take actions like creating drafts, sending updates, labeling records, and more.
  • 1,500+ SaaS toolkits out of the box. Composio gives you instant access to a vast catalog of pre-built connectors, from Gmail and Slack to Notion, Linear, and Salesforce.
  • One MCP server for every app. Connect any of your applications on demand through a single endpoint, rather than juggling a separate server for each app.
  • Smart, context-aware tool loading. Unlike traditional MCP servers that dump every available tool into the LLM context window, Composio searches for and loads only the tools relevant to the task at hand.
  • Cross-app automation. Chain actions across multiple apps in a single run - fetch a thread, summarize it in Notion, and post highlights to Slack without leaving the conversation.

Prerequisites

  • A ChatGPT account. We will use the ChatGPT desktop app, and the steps are the same on the web.
  • Access to the Vercel AI Gateway workspace you want to connect.
  • Composio plugin.

Note: Composio connects through OAuth. You will be asked to sign in and approve specific permissions. Review the permission screen carefully if you are using a work account.

Step-by-step: Connect Vercel AI Gateway to ChatGPT

1. Install the Composio plugin

Click the button. ChatGPT opens the Composio plugin page. Click Install plugin.

Install in ChatGPT

Composio plugin page in ChatGPT with the Install plugin button

You can also find it inside ChatGPT: go to Settings, open Plugins, search the marketplace for Composio, and click Install plugin.

2. Authenticate

After you install, ChatGPT asks you to authenticate with Composio. Log in and click Allow access to authorize ChatGPT to use your Composio account.

Composio login and Allow access screen for ChatGPT

3. Start using Composio

That is it. Composio tools are now available in ChatGPT. Type @Composio followed by your request, for example @Composio find unread Vercel AI Gateway messages and summarize them, and it will run the actions you authorize. On first use it asks you to authorize Vercel AI Gateway.

Option 2: Add Composio as an MCP server

If you cannot use the plugin marketplace, add Composio as a custom MCP server instead.

1. Open the MCP settings

In ChatGPT, go to Settings and open the Plugins section. Inside the Plugins page, click the MCP tab.

ChatGPT settings showing the Plugins page with the MCP tab selected

2. Add the server

Click Add server. In the Name field enter Composio, for Type select Streamable HTTP, and in the URL field paste the Composio MCP server URL:

bash
https://connect.composio.dev/mcp
ChatGPT Add server dialog with the name Composio, type Streamable HTTP, and the Composio MCP URL

Then click Save. The Composio server now appears in your MCP plugins list.

ChatGPT Plugins page showing the Composio MCP server added to the list

3. Authenticate

Click Authenticate on the Composio entry, log in via Composio, and click Allow access. Composio tools are then available in ChatGPT the same way as with the plugin.

What you can do after connecting Vercel AI Gateway

  • List available Vercel AI models and specs
  • Generate marketing copy with Vercel model
  • Fetch usage metrics for your models

Security + privacy notes (important)

  • Use least-privilege access: Only grant permissions you actually need.
  • Review OAuth permissions before approving: Make sure requested scopes match what you expect Composio and ChatGPT to do.
  • Keep write actions human-reviewed: For actions like sending messages, creating labels, or editing drafts, keep manual confirmation enabled.
  • Be careful with sensitive data: Avoid using this setup with highly sensitive information unless allowed by your personal, company, or client policies.
TOOLS

Supported Tools

Every Vercel AI Gateway action and event your agent gets out of the box.

Compact Response

Compact a long OpenAI Responses conversation into replayable context through Vercel AI Gateway.

Count Message Tokens

Estimate input tokens for Anthropic-format messages, system content, and tools before sending a model request through Vercel AI Gateway.

Create Anthropic Message

Create one non-streaming Anthropic Messages-compatible result through Vercel AI Gateway, with multimodal content, tools, extended thinking, and routing controls.

Create Chat Completion

Create one non-streaming OpenAI Chat Completions-compatible result through Vercel AI Gateway, with multimodal messages, tools, structured output, fallback models, and routing controls.

Create Embeddings

Generate OpenAI-compatible vector embeddings through Vercel AI Gateway for text or token inputs, with optional dimensions and routing controls.

Edit Images

Create edited images from up to 16 HTTPS or base64 data-URL source images and a text instruction.

Evaluate State

Evaluate one shared state against one or more typed choice, score, or boolean questions using an AI Gateway evaluation model.

Generate Images

Generate one or more images from a text prompt through an image-only Vercel AI Gateway model.

Generate Response

Generate one non-streaming OpenAI Responses-compatible result through AI Gateway, with optional instructions, tools, structured output, reasoning, and routing controls.

Generate Speech

Generate spoken audio from text through a Vercel AI Gateway speech model.

Get Credit Balance

Return the connected team's remaining AI Gateway credit balance and lifetime credit usage in USD.

Get Generation

Look up cost, token usage, provider routing, latency, and finish details for one completed Vercel AI Gateway generation.

Get Model

Return detailed capabilities, modalities, limits, tags, and pricing for one exact Gateway model ID.

Get Model Endpoints

Compare provider endpoints serving one Vercel AI Gateway model, including limits, pricing, caching, availability, throughput, and latency.

Get Spend Report

Query aggregated Vercel AI Gateway spend and token usage.

List Model Catalog

List AI Gateway model-to-provider routes and capability tags, with bounded local filtering by model text, provider, or tag.

List TypeSafe Models

List evaluation models available through AI Gateway's TypeSafe-compatible API, including each accepted model name, description, and release date.

Rerank Object Documents

Rank structured object documents by relevance through the Cohere v1 route, using selected rank fields and optionally returning each source document.

Rerank Text Documents

Rerank string documents through the current Cohere v2 compatibility endpoint.

Search Models

Search the AI Gateway model catalog by text, model type, and tags, returning capability and pricing metadata for matching models.

Transcribe Audio

Transcribe base64-encoded recorded audio through a Vercel AI Gateway transcription model.

Evaluate with TypeSafe API

Evaluate one shared state through AI Gateway's TypeSafe-compatible System One API.

FAQ

Frequently asked questions

With a standalone Vercel AI Gateway MCP server, the agents and LLMs can only access a fixed set of Vercel AI Gateway tools tied to that server. However, with the Composio Tool Router, agents can dynamically load tools from Vercel AI Gateway and many other apps based on the task at hand, all through a single MCP endpoint.

Yes, you can. ChatGPT fully supports MCP integration. You get structured tool calling, message history handling, and model orchestration while Tool Router takes care of discovering and serving the right Vercel AI Gateway tools.

Yes, absolutely. You can configure which Vercel AI Gateway scopes and actions are allowed when connecting your account to Composio. You can also bring your own OAuth credentials or API configuration so you keep full control over what the agent can do.

All sensitive data such as tokens, keys, and configuration is fully encrypted at rest and in transit. Composio is SOC 2 Type 2 compliant and follows strict security practices so your Vercel AI Gateway data and credentials are handled as safely as possible.

Start with Vercel AI Gateway.It takes 30 seconds.

Managed auth, hosted MCP servers, and every Vercel AI Gateway tool your agent needs.Free to start.

Start building