How to connect VLM Run to Grok Bot

Grok is xAI's assistant, and its bot builder lets you create a personal agent that holds context, runs skills, and connects to the apps you already use through plugins.

This guide explains how to connect VLM Run to a Grok bot using Composio Connect, which handles OAuth, token refresh, and reliability so you do not have to. You add Composio as a plugin, authenticate once, then ask your bot to work with VLM Run in plain language.

Composio exposes 1,500+ apps to your Grok bot through a single connection, so you get:

• Connect to 1,500+ apps with on-demand tool loading, so you do not fill your context window with unnecessary tool definitions.
• Use programmatic tool calling through a remote workbench, letting the model write its own code to handle complex tool chaining. This reduces back-and-forth for frequent tool calls.
• Handle large tool responses outside the model context to keep conversations lean.

Connecting VLM Run to Grok Bot

Once Grok Bot is set up, you connect VLM Run entirely from its interface, and the whole flow takes under a minute.

Set up Grok Bot

Get access. Grok Bot is included with Cursor Ultra, Cursor Premium Teams, and SuperGrok Heavy. Get the desktop app for macOS or Windows from x.ai/bot and sign in. An iPhone companion app is also available, and your bots sync across devices.

Create a bot. Pick a suggested role or define your own, then give it a short name, one primary job, and a short description of how it should work. Focused bots work best, because a clear role gives the bot more useful context over time.

Connect VLM Run

1. Add the Composio plugin

Click the button. The Composio listing on x.ai opens and launches Grok Bot for you. If the app does not open on its own, click Add to Grok Bot.

Add to Grok Bot

Grok Bot opens the Composio plugin, showing its connector and skills. Click Add.

2. Authenticate

Go to the Installed section and click the Composio entry. You'll see its connector and skills listed.

Click Authenticate. You'll be taken to the Composio consent screen. Review the access it requests and click Authorize. Composio handles the OAuth handshake for you, so you never touch API keys or tokens.

3. Connect your VLM Run account

Back in the chat, ask your bot to connect to VLM Run or give it any VLM Run task.

For example, ask it to:

• "Extract invoice fields from uploaded PDFs"
• "Classify product images by defect type"
• "Evaluate extraction quality against gold labels"

It will prompt you to authenticate and authorize access.

That's it. Composio's tools are now available in your Grok bot, and your VLM Run account is ready to use.

Grok is xAI's assistant, available as a chat interface and a bot builder for creating personal agents that run skills and connect to external apps.

With Composio Connect, your Grok bot can securely access apps like VLM Run through MCP without you sharing account credentials directly with the agent.

The VLM Run MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your VLM Run account. It provides structured and secure access to your multimodal agents, files, skills, extraction workflows, and runs, so your agent can upload files, extract structured data, execute agents, create reusable skills, and track results on your behalf.

• Structured data extraction: Have your agent extract structured JSON from documents, images, videos, or audio using a supported domain, custom schema, or existing skill.
• Multimodal agent execution: Direct your agent to choose an available VLM Run agent or provide an inline configuration, then run it against multimodal inputs.
• File and skill management: Let the agent upload local files, find previously uploaded files, browse existing skills, or create a reusable skill from an uploaded zip, prompt, or chat session.
• Run tracking and result retrieval: Instruct your agent to list extraction and agent runs, check work in progress, and retrieve completed results.
• Schema and artifact discovery: Have your agent explore supported extraction domains and schemas, then list artifacts created during a chat session or agent execution.

Way Forward

Now that VLM Run is connected, extend your setup by connecting the other apps you already use every day, so your Grok bot can run true cross-app workflows end to end.

• Connect Calendar to turn threads into scheduled meetings automatically.
• Connect Slack or Teams to post summaries, approvals, and alerts where your team works.
• Connect Notion, Linear, Jira, or Asana to convert requests into tickets, tasks, and docs.
• Connect Drive, Dropbox, or OneDrive to fetch, file, and share attachments without manual steps.

Start with one workflow you do repeatedly, then keep adding apps as you find new handoffs. With everything behind a single connection, your bot can coordinate multiple tools safely and reliably in one conversation.