Scrape Website
Extracts data from a specified website URL using Browse AI's scraping capabilities.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.SCRAPE_WEBSITE])
Create Robot
Creates a new web scraping robot with specified parameters and scraping instructions.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.CREATE_ROBOT])
Update Robot
Modifies an existing web scraping robot's configuration or scraping instructions.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.UPDATE_ROBOT])
Delete Robot
Removes a specified web scraping robot from the Browse AI system.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.DELETE_ROBOT])
Run Robot
Executes a specific web scraping robot to collect data from its target website.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.RUN_ROBOT])
Get Robot Results
Retrieves the latest scraping results from a specified robot's most recent run.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.GET_ROBOT_RESULTS])
List Robots
Retrieves a list of all web scraping robots associated with the user's account.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.LIST_ROBOTS])
Get Robot Details
Fetches detailed information about a specific web scraping robot.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.GET_ROBOT_DETAILS])
Create Task
Sets up a new scraping task with specific parameters and scheduling options.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.CREATE_TASK])
Cancel Task
Stops and cancels an ongoing or scheduled scraping task.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.CANCEL_TASK])
Get Task Status
Checks the current status of a specific scraping task.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.GET_TASK_STATUS])
List Tasks
Retrieves a list of all scraping tasks associated with the user's account.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.LIST_TASKS])
Export Data
Exports scraped data in a specified format (e.g., CSV, JSON) for download or further processing.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.EXPORT_DATA])
Set Proxy
Configures a proxy server for use with web scraping robots to avoid IP blocks.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.SET_PROXY])
Create API Key
Generates a new API key for programmatic access to Browse AI services.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.CREATE_API_KEY])
Revoke API Key
Invalidates an existing API key for security purposes.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.REVOKE_API_KEY])
Set Rate Limit
Configures the rate limiting settings for a specific robot or all robots.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.SET_RATE_LIMIT])
Set User Agent
Specifies a custom User-Agent string for a robot's HTTP requests.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.SET_USER_AGENT])
Enable JavaScript
Activates JavaScript execution for a specific robot to scrape dynamic content.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.ENABLE_JAVASCRIPT])
New Data Available
Fires when new data is scraped and available from a specified robot.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.NEW_DATA_AVAILABLE])
Scraping Error Occurred
Triggers when a scraping operation encounters an error or fails to complete.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.SCRAPING_ERROR])
Robot Created
Activates when a new web scraping robot is successfully created in the system.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.ROBOT_CREATED])
Robot Updated
Fires when an existing web scraping robot's configuration is modified.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.ROBOT_UPDATED])
Robot Deleted
Triggers when a web scraping robot is removed from the system.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.ROBOT_DELETED])
Task Completed
Activates when a scraping task finishes its execution successfully.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.TASK_COMPLETED])
Rate Limit Reached
Fires when a robot or account reaches its configured rate limit for scraping.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.RATE_LIMIT_REACHED])
API Key Created
Triggers when a new API key is generated for the account.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.API_KEY_CREATED])
API Key Revoked
Activates when an existing API key is invalidated or revoked.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.API_KEY_REVOKED])
Quota Exceeded
Fires when the account's scraping quota or limit is exceeded.
from composio_crewai import ComposioToolSet, Action
tool_set = ComposioToolSet()
tools = tool_set.get_tools(actions=[Action.QUOTA_EXCEEDED])