# Ollama CLI for AI Agents ```json { "title": "Ollama CLI for AI Agents", "toolkit": "Ollama", "toolkit_slug": "ollama", "framework": "CLI", "framework_slug": "cli", "url": "https://composio.dev/toolkits/ollama/framework/cli", "markdown_url": "https://composio.dev/toolkits/ollama/framework/cli.md", "updated_at": "2026-03-29T06:43:54.501Z" } ``` ## Introduction CLIs are eating MCPs. The industry is converging on the very same idea. MCPs for all their merit can be token hungry, slow, and unreliable for complex tool chaining. However, coding agents have become incredibly good at working with CLIs, and in fact they are far more comfortable working with CLI tools than MCP. With Composio's Universal CLI, your coding agents can talk to over 1000+ SaaS applications. With Ollama, agents can run a custom prompt with llama2, get model info for all installed models, generate a text completion using mistral, and more — all without worrying about authentication. This guide walks you through Composio Universal CLI and explains how you can connect it with coding agents like Claude Code, Codex, OpenCode, etc, for end-to-end Ollama automation. ## Also integrate Ollama with - [ChatGPT](https://composio.dev/toolkits/ollama/framework/chatgpt) - [OpenAI Agents SDK](https://composio.dev/toolkits/ollama/framework/open-ai-agents-sdk) - [Claude Agent SDK](https://composio.dev/toolkits/ollama/framework/claude-agents-sdk) - [Claude Code](https://composio.dev/toolkits/ollama/framework/claude-code) - [Claude Cowork](https://composio.dev/toolkits/ollama/framework/claude-cowork) - [Codex](https://composio.dev/toolkits/ollama/framework/codex) - [Cursor](https://composio.dev/toolkits/ollama/framework/cursor) - [VS Code](https://composio.dev/toolkits/ollama/framework/vscode) - [OpenCode](https://composio.dev/toolkits/ollama/framework/opencode) - [OpenClaw](https://composio.dev/toolkits/ollama/framework/openclaw) - [Hermes](https://composio.dev/toolkits/ollama/framework/hermes-agent) - [Google ADK](https://composio.dev/toolkits/ollama/framework/google-adk) - [LangChain](https://composio.dev/toolkits/ollama/framework/langchain) - [Vercel AI SDK](https://composio.dev/toolkits/ollama/framework/ai-sdk) - [Mastra AI](https://composio.dev/toolkits/ollama/framework/mastra-ai) - [LlamaIndex](https://composio.dev/toolkits/ollama/framework/llama-index) - [CrewAI](https://composio.dev/toolkits/ollama/framework/crew-ai) ## TL;DR The idea behind building the universal CLI is to give agents a single command interface to interact with all your external applications. Here's what you'll get with it: - Agent-friendly: Coding agents like Claude Code, Codex, and OpenCode can use CLI tools natively — no MCP setup required. - Authentication handled: Connect once via OAuth or API Key, and all CLI commands work with your credentials automatically. - Tool discovery: Search, inspect, and execute 20,000+ tools across 1000+ apps from one interface. - Trigger support: Use triggers to listen for events across your apps, powered by real-time webhooks or polling under the hood. - Type generation: Generate typed schemas for autocomplete and type safety in your projects. ## Connect Ollama to CLI ### Prerequisites Install the Composio CLI, authenticate, and initialize your project: ```bash # Install the Composio CLI curl -fsSL https://composio.dev/install | bash # Authenticate with Composio composio login ``` ## What is the Ollama MCP server, and what's possible with it? The Ollama MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your Ollama account. It provides structured and secure access so your agent can perform Ollama operations on your behalf. ## Supported Tools | Tool slug | Name | Description | |---|---|---| | `OLLAMA_CHAT` | Chat with Ollama model | Tool to send a chat message with conversation history to Ollama. Use when you need to have a multi-turn conversation with an LLM model. | | `OLLAMA_GENERATE` | Generate Text with Ollama | Tool to generate text responses from Ollama models with optional raw mode. Use raw=true to bypass prompt templating when you need full control over the prompt for debugging or custom processing. Note that raw mode will not return a context. | | `OLLAMA_LIST_MODELS` | List Models | Tool to list all available Ollama models and their details. Use when you need to fetch installed models with metadata including name, size, last modified timestamp, digest, and format information. | | `OLLAMA_OPEN_AI_CHAT_COMPLETIONS` | OpenAI-Compatible Chat Completion | Tool to create OpenAI-compatible chat completions using Ollama models. Use when you need conversational AI responses with OpenAI API format compatibility. | | `OLLAMA_OPENAI_COMPATIBLE_TEXT_COMPLETION` | OpenAI-Compatible Text Completion | Tool to create OpenAI-compatible text completions using Ollama models. Use when you need text generation with OpenAI API format compatibility beyond chat-based interactions. | | `OLLAMA_LIST_MODELS_OPENAI_COMPATIBLE` | List Models (OpenAI Compatible) | Tool to list available models using OpenAI-compatible API format. Use when you need to retrieve locally available Ollama models with metadata following OpenAI's model list format. | | `OLLAMA_SHOW_MODEL_INFORMATION` | Show Model Information | Tool to show comprehensive information about an Ollama model. Use when you need to retrieve model details, parameters, template, license, or system prompt. | | `OLLAMA_GET_OLLAMA_VERSION` | Get Ollama Version | Tool to get the version of Ollama running locally. Use to check which version of Ollama is currently installed. | ## Supported Triggers None listed. ## Complete Code None listed. ## Conclusion - Try asking your coding agent to perform various Ollama operations - Explore cross-app workflows by connecting more toolkits - Set up triggers for real-time automation - Use composio generate for typed schemas in your projects ## How to build Ollama MCP Agent with another framework - [ChatGPT](https://composio.dev/toolkits/ollama/framework/chatgpt) - [OpenAI Agents SDK](https://composio.dev/toolkits/ollama/framework/open-ai-agents-sdk) - [Claude Agent SDK](https://composio.dev/toolkits/ollama/framework/claude-agents-sdk) - [Claude Code](https://composio.dev/toolkits/ollama/framework/claude-code) - [Claude Cowork](https://composio.dev/toolkits/ollama/framework/claude-cowork) - [Codex](https://composio.dev/toolkits/ollama/framework/codex) - [Cursor](https://composio.dev/toolkits/ollama/framework/cursor) - [VS Code](https://composio.dev/toolkits/ollama/framework/vscode) - [OpenCode](https://composio.dev/toolkits/ollama/framework/opencode) - [OpenClaw](https://composio.dev/toolkits/ollama/framework/openclaw) - [Hermes](https://composio.dev/toolkits/ollama/framework/hermes-agent) - [Google ADK](https://composio.dev/toolkits/ollama/framework/google-adk) - [LangChain](https://composio.dev/toolkits/ollama/framework/langchain) - [Vercel AI SDK](https://composio.dev/toolkits/ollama/framework/ai-sdk) - [Mastra AI](https://composio.dev/toolkits/ollama/framework/mastra-ai) - [LlamaIndex](https://composio.dev/toolkits/ollama/framework/llama-index) - [CrewAI](https://composio.dev/toolkits/ollama/framework/crew-ai) ## Related Toolkits - [Composio](https://composio.dev/toolkits/composio) - Composio is an integration platform that connects AI agents with hundreds of business tools. It streamlines authentication and lets you trigger actions across services—no custom code needed. - [Composio search](https://composio.dev/toolkits/composio_search) - Composio search is a unified web search toolkit spanning travel, e-commerce, news, financial markets, images, and more. It lets you and your apps tap into up-to-date web data from a single, easy-to-integrate service. - [Perplexityai](https://composio.dev/toolkits/perplexityai) - Perplexityai delivers natural, conversational AI models for generating human-like text. Instantly get context-aware, high-quality responses for chat, search, or complex workflows. - [Browser tool](https://composio.dev/toolkits/browser_tool) - Browser tool is a virtual browser integration that lets AI agents interact with the web programmatically. It enables automated browsing, scraping, and action-taking from any AI workflow. - [Ai ml api](https://composio.dev/toolkits/ai_ml_api) - Ai ml api is a suite of AI/ML models for natural language and image tasks. It provides fast, scalable access to advanced AI capabilities for your apps and workflows. - [Aivoov](https://composio.dev/toolkits/aivoov) - Aivoov is an AI-powered text-to-speech platform offering 1,000+ voices in over 150 languages. Instantly turn written content into natural, human-like audio for any application. - [All images ai](https://composio.dev/toolkits/all_images_ai) - All-Images.ai is an AI-powered image generation and management platform. It helps you create, search, and organize images effortlessly with advanced AI capabilities. - [Anthropic administrator](https://composio.dev/toolkits/anthropic_administrator) - Anthropic administrator is an API for managing Anthropic organizational resources like members, workspaces, and API keys. It helps you automate admin tasks and streamline resource management across your Anthropic organization. - [Api labz](https://composio.dev/toolkits/api_labz) - Api labz is a platform offering a suite of AI-driven APIs and workflow tools. It helps developers automate tasks and build smarter, more efficient applications. - [Apipie ai](https://composio.dev/toolkits/apipie_ai) - Apipie ai is an AI model aggregator offering a single API for accessing top AI models from multiple providers. It helps developers build cost-efficient, latency-optimized AI solutions without juggling multiple integrations. - [Astica ai](https://composio.dev/toolkits/astica_ai) - Astica ai provides APIs for computer vision, NLP, and voice synthesis. Integrate advanced AI features into your app with a single API key. - [Bigml](https://composio.dev/toolkits/bigml) - BigML is a machine learning platform that lets you build, train, and deploy predictive models from your data. Its intuitive interface and robust API make machine learning accessible and efficient. - [Botbaba](https://composio.dev/toolkits/botbaba) - Botbaba is a platform for building, managing, and deploying conversational AI chatbots across messaging channels. It streamlines chatbot automation, making it easier to integrate AI into customer interactions. - [Botpress](https://composio.dev/toolkits/botpress) - Botpress is an open-source platform for building, deploying, and managing chatbots. It helps teams automate conversations and deliver rich, interactive messaging experiences. - [Chatbotkit](https://composio.dev/toolkits/chatbotkit) - Chatbotkit is a platform for building and managing AI-powered chatbots using robust APIs and SDKs. It lets you easily add conversational AI to your apps for better user engagement. - [Cody](https://composio.dev/toolkits/cody) - Cody is an AI assistant built for businesses, trained on your company's knowledge and data. It delivers instant answers and insights, tailored for your team. - [Context7 MCP](https://composio.dev/toolkits/context7_mcp) - Context7 MCP delivers live, version-specific code docs and examples right from the source. It helps developers and AI agents instantly retrieve authoritative programming info—no more out-of-date docs. - [Customgpt](https://composio.dev/toolkits/customgpt) - CustomGPT.ai lets you build and deploy chatbots tailored to your own data and business needs. Get precise and context-aware AI conversations without writing code. - [Datarobot](https://composio.dev/toolkits/datarobot) - Datarobot is a machine learning platform that automates model development, deployment, and monitoring. It empowers organizations to quickly gain predictive insights from large datasets. - [Deepgram](https://composio.dev/toolkits/deepgram) - Deepgram is an AI-powered speech recognition platform for accurate audio transcription and understanding. It enables fast, scalable speech-to-text with advanced audio intelligence features. ## Frequently Asked Questions ### What is the Composio Universal CLI? The Composio Universal CLI is a single command-line interface that lets coding agents and developers interact with 1000+ SaaS applications. It handles authentication, tool discovery, action execution, and trigger setup — all from the terminal, without needing to configure MCP servers. ### Which coding agents work with the Composio CLI? Any coding agent that can run shell commands works with the Composio CLI — including Claude Code, Codex, OpenCode, OpenClaw, and others. Once the CLI is installed, agents automatically discover and use the composio commands to interact with Ollama and other connected apps. ### How is the CLI different from using an MCP server for Ollama? MCP servers require configuration and can be token-heavy for complex workflows. The CLI gives agents a direct, lightweight interface — no server setup needed. Agents simply call composio commands like any other shell tool. It's faster to set up, more reliable for multi-step tool chaining, and works natively with how coding agents already operate. ### How safe is my Ollama data when using the Composio CLI? All sensitive data such as tokens, keys, and configuration is fully encrypted at rest and in transit. Composio is SOC 2 Type 2 compliant and follows strict security practices so your Ollama data and credentials are handled as safely as possible. You can also bring your own OAuth credentials for full control. --- [See all toolkits](https://composio.dev/toolkits) · [Composio docs](https://docs.composio.dev/llms.txt)