How to connect Ollama to Grok Bot

Connect Grok Bot to Ollama MCP. Run a custom prompt with llama2, get model info for all installed models, and more using natural language, with authentication handled for you.

Ollama logoOllama
Api Key

Ollama lets you run large language models locally or in the cloud. Enjoy fast, flexible LLM workflows without vendor lock-in.

8 Tools

Introduction

Grok is xAI's assistant, and its bot builder lets you create a personal agent that holds context, runs skills, and connects to the apps you already use through plugins.

This guide explains how to connect Ollama to a Grok bot using Composio Connect, which handles OAuth, token refresh, and reliability so you do not have to. You add Composio as a plugin, authenticate once, then ask your bot to work with Ollama in plain language.

Also integrate Ollama with

Why use Composio?

Composio exposes 1,500+ apps to your Grok bot through a single connection, so you get:

  • Connect to 1,500+ apps with on-demand tool loading, so you do not fill your context window with unnecessary tool definitions.
  • Use programmatic tool calling through a remote workbench, letting the model write its own code to handle complex tool chaining. This reduces back-and-forth for frequent tool calls.
  • Handle large tool responses outside the model context to keep conversations lean.

Connecting Ollama to Grok Bot

Once Grok Bot is set up, you connect Ollama entirely from its interface, and the whole flow takes under a minute.

Set up Grok Bot

Get access. Grok Bot is included with Cursor Ultra, Cursor Premium Teams, and SuperGrok Heavy. Get the desktop app for macOS or Windows from x.ai/bot and sign in. An iPhone companion app is also available, and your bots sync across devices.

Create a bot. Pick a suggested role or define your own, then give it a short name, one primary job, and a short description of how it should work. Focused bots work best, because a clear role gives the bot more useful context over time.

Connect Ollama

1. Add the Composio plugin

Click the button. The Composio listing on x.ai opens and launches Grok Bot for you. If the app does not open on its own, click Add to Grok Bot.

Add to Grok Bot

Composio for Grok Bot listing on x.ai with the Add to Grok Bot button

Grok Bot opens the Composio plugin, showing its connector and skills. Click Add.

Composio plugin sheet in Grok Bot with the Add button

2. Authenticate

Go to the Installed section and click the Composio entry. You'll see its connector and skills listed.

Installed Composio plugin showing the Authenticate button

Click Authenticate. You'll be taken to the Composio consent screen. Review the access it requests and click Authorize. Composio handles the OAuth handshake for you, so you never touch API keys or tokens.

Composio authorization screen with Authorize and Deny

3. Connect your Ollama account

Back in the chat, ask your bot to connect to Ollama or give it any Ollama task.

For example, ask it to:

  • "Run a custom prompt with llama2"
  • "Get model info for all installed models"
  • "Generate a text completion using mistral"

It will prompt you to authenticate and authorize access.

That's it. Composio's tools are now available in your Grok bot, and your Ollama account is ready to use.

What is Grok Bot?

Grok is xAI's assistant, available as a chat interface and a bot builder for creating personal agents that run skills and connect to external apps.

With Composio Connect, your Grok bot can securely access apps like Ollama through MCP without you sharing account credentials directly with the agent.

What is the Ollama MCP server, and what's possible with it?

The Ollama MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your Ollama account. It provides structured and secure access to your Ollama models, so your agent can chat with models, generate text, list available models, inspect model details, and create compatible chat or text completions on your behalf.

  • Model conversations: Have your agent send chat messages with conversation history to an Ollama model for contextual responses.
  • Text generation: Direct your agent to generate text with an available Ollama model, including output in raw mode when needed.
  • Model discovery: Let the agent list your available Ollama models and review their details.
  • Model information: Instruct your agent to retrieve information about a specific Ollama model.
  • Compatible completions: Have your agent create OpenAI-compatible chat or text completions using Ollama models.

Way Forward

Now that Ollama is connected, extend your setup by connecting the other apps you already use every day, so your Grok bot can run true cross-app workflows end to end.

  • Connect Calendar to turn threads into scheduled meetings automatically.
  • Connect Slack or Teams to post summaries, approvals, and alerts where your team works.
  • Connect Notion, Linear, Jira, or Asana to convert requests into tickets, tasks, and docs.
  • Connect Drive, Dropbox, or OneDrive to fetch, file, and share attachments without manual steps.

Start with one workflow you do repeatedly, then keep adding apps as you find new handoffs. With everything behind a single connection, your bot can coordinate multiple tools safely and reliably in one conversation.

TOOLS

Supported Tools

Every Ollama action and event your agent gets out of the box.

Chat with Ollama model

Tool to send a chat message with conversation history to Ollama.

Generate Text with Ollama

Tool to generate text responses from Ollama models with optional raw mode.

List Models

Tool to list all available Ollama models and their details.

OpenAI-Compatible Chat Completion

Tool to create OpenAI-compatible chat completions using Ollama models.

OpenAI-Compatible Text Completion

Tool to create OpenAI-compatible text completions using Ollama models.

List Models (OpenAI Compatible)

Tool to list available models using OpenAI-compatible API format.

Show Model Information

Tool to show comprehensive information about an Ollama model.

Get Ollama Version

Tool to get the version of Ollama running locally.

FAQ

Frequently asked questions

With a standalone Ollama MCP server, the agents and LLMs can only access a fixed set of Ollama tools tied to that server. However, with the Composio Tool Router, agents can dynamically load tools from Ollama and many other apps based on the task at hand, all through a single MCP endpoint.

Yes, you can. Grok Bot fully supports MCP integration. You get structured tool calling, message history handling, and model orchestration while Tool Router takes care of discovering and serving the right Ollama tools.

Yes, absolutely. You can configure which Ollama scopes and actions are allowed when connecting your account to Composio. You can also bring your own OAuth credentials or API configuration so you keep full control over what the agent can do.

All sensitive data such as tokens, keys, and configuration is fully encrypted at rest and in transit. Composio is SOC 2 Type 2 compliant and follows strict security practices so your Ollama data and credentials are handled as safely as possible.

Start with Ollama.It takes 30 seconds.

Managed auth, hosted MCP servers, and every Ollama tool your agent needs.Free to start.

Start building