X (Twitter)LinkedInGitHubDiscordYouTube

Fireworks AI MCP for AI Agents

Securely connect your AI agents and chatbots (Claude, ChatGPT, Cursor, etc) with Fireworks AI MCP or direct API to run model inference, manage deployments, create datasets, launch fine-tuning jobs, and review evaluations through natural language.

Get started for freeGet a demo
Fireworks AI logoFireworks AI
Api Key

Fireworks AI is a serverless AI platform for model inference, fine-tuning, deployments, datasets, and evaluations. Use it to run fast open-model workflows without managing GPU infrastructure.

9 Tools

Try Fireworks AI now

Type what you want done — sign in and watch it run live in the Tool Router playground.

TOOL ROUTER PLAYGROUND
Fireworks AI
Try asking
TOOLS

Supported Tools

Every Fireworks AI action and event your agent gets out of the box.

Create Chat Completion

Generate one non-streaming OpenAI-compatible chat completion from role-based messages using a caller-supplied Fireworks model or deployment ID.

Create Embeddings

Create embedding vectors for one or more caller-provided inputs using a caller-supplied Fireworks embedding model.

Generate Model Response

Generate one non-streaming Responses API result, optionally continuing a stored response or using function, MCP, or SSE tools; storage is off by default.

Get Deployment

Return configuration and serving status for one Fireworks deployment without scaling or modifying it.

Get Model

Return metadata and status for one model resource in a Fireworks account; this does not test whether the model can serve inference.

List Accounts

Return one page of Fireworks accounts accessible to the API key so an agent can obtain account IDs for model and deployment discovery.

List Deployments

Return one page of deployment resources in a Fireworks account for deployment ID discovery and serving-capacity and status inspection.

List Models

Return one page of model resources in a Fireworks account for model-ID discovery and status inspection; availability for inference is not guaranteed.

Rerank Documents

Rank a provided document list by relevance to a query using an optional caller-supplied Fireworks reranker model.

SETUP GUIDE

Connect Fireworks AI MCP Tool with your Agent

1

Install Composio

typescript
npm install @composio/core ai @ai-sdk/openai @ai-sdk/mcp
Install the Composio SDK for Python or TypeScript
2

Initialize Client and Create Tool Router Session

typescript
import { Composio } from '@composio/core';

const composio = new Composio({ apiKey: 'your-api-key' });
const session = await composio.create('your-user-id');
console.log(`Tool Router session created: ${session.mcp.url}`);
Import and initialize the Composio client, then create a Tool Router session for Fireworks AI
3

Connect to AI Agent

typescript
import { openai } from '@ai-sdk/openai';
import { experimental_createMCPClient as createMCPClient } from '@ai-sdk/mcp';
import { generateText } from 'ai';

const client = await createMCPClient({
  transport: {
    type: 'http',
    url: session.mcp.url,
    headers: {
      'x-api-key': 'your-composio-api-key',
    },
  },
});

const tools = await client.tools();
const { text } = await generateText({
  model: openai('gpt-4o'),
  tools,
  messages: [{
    role: 'user',
    content: 'List active Fireworks AI deployments'
  }],
  maxSteps: 5,
});

console.log(`Agent: ${text}`);
Use the MCP server with your AI agent (Anthropic Claude or Mastra)
SETUP GUIDE

Connect Fireworks AI API Tool with your Agent

1

Install Composio

typescript
npm install @composio/openai
Install the Composio SDK
2

Initialize Composio and Create Tool Router Session

typescript
import OpenAI from 'openai';
import { Composio } from '@composio/core';
import { OpenAIResponsesProvider } from '@composio/openai';

const composio = new Composio({
  provider: new OpenAIResponsesProvider(),
});
const openai = new OpenAI({});
const session = await composio.create('your-user-id');
Import and initialize Composio client, then create a Tool Router session
3

Execute Fireworks AI Tools via Tool Router with Your Agent

typescript
const tools = session.tools;
const response = await openai.responses.create({
  model: 'gpt-4.1',
  tools: tools,
  input: [{
    role: 'user',
    content: 'List active Fireworks AI deployments'
  }],
});
const result = await composio.provider.handleToolCalls(
  'your-user-id',
  response.output
);
console.log(result);
Get tools from Tool Router session and execute Fireworks AI actions with your Agent

Why Use Composio?

AI Native Fireworks AI Integration

  • Supports both Fireworks AI MCP and direct API based integrations
  • Structured, LLM-friendly schemas for reliable model, dataset, deployment, and evaluation actions
  • Rich coverage for reading, writing, and querying Fireworks AI resources without bespoke integration code

Managed Auth

  • Secure API key handling so your agents don't need hard-coded Fireworks AI credentials
  • Central place to manage, scope, and revoke Fireworks AI access
  • Per user and per environment credentials for safer development and production use

Agent Optimized Design

  • Tools are designed so language models can reliably understand Fireworks AI actions and inputs
  • Execution logs show what your agent ran, when it ran, and which Fireworks AI account it used
  • Cleaner error handling helps agents recover when an inference, dataset, or deployment action needs adjustment

Enterprise Grade Security

  • Fine-grained RBAC so you control which agents and users can access Fireworks AI
  • Scoped, least privilege access to Fireworks AI resources like models, deployments, datasets, and evaluations
  • Full audit trail of agent actions to support review, debugging, and compliance
FAQ

Frequently asked questions

Yes, Fireworks AI requires you to configure your own API key. Once set up, Composio handles secure credential storage and API request handling for you.

Yes! Composio's Tool Router enables agents to use multiple toolkits. Learn more.

Composio is SOC 2 and ISO 27001 compliant with all data encrypted in transit and at rest. Learn more.

Composio maintains and updates all toolkit integrations automatically, so your agents always work with the latest API versions.

Start with Fireworks AI.It takes 30 seconds.

Managed auth, hosted MCP servers, and every Fireworks AI tool your agent needs.Free to start.

Start building