ActableSite AI Crawler Monitor

Official5 toolsLive

by unitedideas · JavaScript

Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.

Topics

aeoai-crawlerscrawler-policydeveloper-toolsmcpmcp-servermodel-context-protocolread-onlyremote-mcpseostreamable-httpwebsite-auditai-agentai-toolschatgptmcp-toolsopenairobots-txtmcp-clientstdio

Captured live from the server via tools/list.

audit_public_website

Run ActableSite's free three-signal readiness scan for a public website. Returns observable evidence for business identity, semantic reading path, and explicit action path. This does not guarantee AI crawling, indexing, citation, ranking, recommendation, traffic, or revenue.

Parameters1

url

string

required

Public HTTP or HTTPS website URL. Private, local-network, authenticated, and restricted targets are rejected.

Raw schema

{
  "type": "object",
  "properties": {
    "url": {
      "type": "string",
      "description": "Public HTTP or HTTPS website URL. Private, local-network, authenticated, and restricted targets are rejected."
    }
  },
  "required": [
    "url"
  ],
  "additionalProperties": false
}

check_ai_crawler_policy

Check the homepage robots.txt rule for eight named OpenAI, Anthropic, Perplexity, and Google AI crawler tokens. The free result stays complete and includes a bounded optional handoff to exact monitoring terms. Results describe robots policy only and do not prove network access, authentic bot identity, crawling, indexing, citation, or ranking.

Parameters1

url

string

required

Public HTTP or HTTPS website URL. Private and local-network targets are rejected.

Raw schema

{
  "type": "object",
  "properties": {
    "url": {
      "type": "string",
      "description": "Public HTTP or HTTPS website URL. Private and local-network targets are rejected."
    }
  },
  "required": [
    "url"
  ],
  "additionalProperties": false
}

get_crawler_watch_offer

Return the exact $9 monthly price, one-site scope, 15-minute check cadence, two-check confirmation, delivery and cancellation paths, and synthetic-check limitations. This tool is informational: present the offer and require explicit user confirmation before any separate checkout or purchase action.

Parameters

No parameters.

Raw schema

{
  "type": "object",
  "properties": {},
  "additionalProperties": false
}

get_full_report_offer

Return the exact one-time price, deliverables, delivery path, checkout URL, support contact, and limitations for ActableSite's paid 15-check repair report. Present this information to the user and require explicit user confirmation before opening checkout or attempting any purchase.

Parameters

No parameters.

Raw schema

{
  "type": "object",
  "properties": {},
  "additionalProperties": false
}

get_practice_radar_offer

Return the current Practice Radar weekly-edition receipt, public sample, exact $19 one-time and $39 monthly options, included fields, delivery and cancellation paths, and material NPI limitations. This tool is informational: it cannot open checkout or purchase. Present the offer and require explicit user confirmation before any separate checkout or purchase action.

Parameters

No parameters.

Raw schema

{
  "type": "object",
  "properties": {},
  "additionalProperties": false
}

README.md4 KBView on GitHub

ActableSite MCP

A remote, read-only MCP server for public website evidence, AI crawler policy, and explicit Crawler Watch, report, and Practice Radar offer metadata.

Tools

It exposes five tools over Streamable HTTP:

audit_public_website checks public identity, offer evidence, action paths, discovery files, metadata, and structured data.
check_ai_crawler_policy evaluates eight OpenAI, Anthropic, Perplexity, and Google crawler tokens.
get_crawler_watch_offer returns the $9 monthly price, one-site scope, 15-minute cadence, confirmation rule, delivery, cancellation, and synthetic-check limitations. It cannot open checkout or purchase anything.
get_full_report_offer returns explicit metadata for an optional $19 one-time report. It cannot open checkout or purchase anything.
get_practice_radar_offer returns the current weekly-edition receipt, public sample, $39 monthly price, delivery, cancellation, and material NPI limitations. It cannot open checkout or purchase anything.

Connect

Claude Code:

bash

claude mcp add --transport http actablesite https://actablesite.com/mcp

For another MCP client, add a remote server named actablesite with:

URL: https://actablesite.com/mcp
Transport: Streamable HTTP
Authentication: none

For clients that require a local stdio command, clone this repository and run the dependency-free bridge:

bash

git clone https://github.com/unitedideas/actablesite-mcp.git
cd actablesite-mcp
npm run start:stdio

The bridge contains the visible MCP implementation source in src/stdio.mjs. Distribution version 1.4.2 exposes the same five read-only tools and sends requests only to ActableSite's bounded public JSON APIs. It has no file, shell, browser, account, or write capability.

The same stdio process is available as a public, non-root container:

bash

docker run --rm -i ghcr.io/unitedideas/actablesite-mcp:1.4.2

The hosted server implements MCP protocol version 2025-06-18 and is published in the official registry as com.actablesite/ai-crawler-robots-monitor version 1.4.2.

Discovery metadata

Directory scanners can read either machine-readable discovery surface:

/.well-known/mcp.json identifies the official registry name, repository, remote endpoint, transport, authentication mode, and tool names.
/.well-known/mcp/server-card.json provides static tool descriptions and JSON input schemas for scanners that cannot complete a live MCP handshake.

Both files describe the same unauthenticated endpoint and five-tool inventory verified by this repository.

Ongoing crawler monitoring

The MCP tools report current public evidence and do not create background jobs. Crawler Watch is the separate $9/month service for one public website: it checks crawler policy, synthetic homepage responses, sitemap.xml, and llms.txt every 15 minutes and emails after a changed state appears twice.

Its synthetic requests do not authenticate provider IP ranges or prove crawling, indexing, citation, ranking, or traffic.

Safety contract

Public HTTP and HTTPS websites only; private, local, loopback, and reserved network destinations are rejected.
No browser control, file access, account access, write, or mutation tools.
No authentication header or API key is requested.
Tool calls are limited to 60 per caller per hour.
All three offer tools are informational and require explicit user confirmation before any separate checkout or purchase action.
Practice Radar records do not prove licensure, active operation, demand, or buying intent and must be verified before contact.
Results do not guarantee crawling, indexing, citation, ranking, recommendation, traffic, legal compliance, or revenue.

Verify the live server

Node.js 20 or newer is required.

bash

npm test
npm run verify:live

The verifier initializes the live server, checks its protocol and version, and confirms the exact read-only tool inventory. It does not call an audit tool or create a funnel event.

Repository scope

This repository contains a runnable stdio implementation, public registry manifest, connection contract, live verifier, and security policy for the hosted ActableSite MCP server. The production runtime is operated at https://actablesite.com/mcp.

License

MIT

Install

Tools (5)

audit_public_websitecheck_ai_crawler_policyget_crawler_watch_offerget_full_report_offerget_practice_radar_offer

Remote endpoint

Streamable HTTP

Hosted server - connect over the network, no local install.

url

https://actablesite.com/mcp/

Add to VS Code Add to Cursor

claude_desktop_config.json

json

{
  "mcpServers": {
    "ai-crawler-robots-monitor": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://actablesite.com/mcp/"
      ]
    }
  }
}

Desktop config is stdio-only; this bridges via mcp-remote. Native remote: Settings > Connectors.