RUN IN TERMINAL
# See repository for install instructions
ADD TO claude_desktop_config.json
{
"mcpServers": {
"comactablesite-ai-crawler-robots-monitor": {
"command": "npx",
"args": []
}
}
}
ADD TO .vscode/mcp.json
{
"mcpServers": {
"comactablesite-ai-crawler-robots-monitor": {
"command": "npx",
"args": []
}
}
}
ADD TO .cursor/mcp.json
{
"mcpServers": {
"comactablesite-ai-crawler-robots-monitor": {
"command": "npx",
"args": []
}
}
}
TRY THIS MCP
Loading available tools...
About This MCP Server
Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.. This is a Model Context Protocol (MCP) server that extends AI assistants like Claude with ai & machine learning capabilities via the streamable-http transport.
HOW TO USE
Select your AI client above to get the install command. This MCP server uses the streamable-http transport.
What tools does it provide?
The ActableSite AI Crawler Monitor server extends your AI assistant with ai & machine learning capabilities. Once installed, your AI can use its tools automatically.
