Connect

8 clients · secrets stay placeholders

JSON (mcpServers)Claude CodeCodexOpenCodeCursorVS CodeGemini CLIGoose

{
  "mcpServers": {
    "robots-check": {
      "type": "http",
      "url": "https://robots-check.quietworklabs.workers.dev/mcp"
    }
  }
}

claude mcp add --transport http robots-check https://robots-check.quietworklabs.workers.dev/mcp

[mcp_servers.robots-check]
url = "https://robots-check.quietworklabs.workers.dev/mcp"

{
  "$schema": "https://opencode.ai/config.json",
  "mcp": {
    "robots-check": {
      "type": "remote",
      "url": "https://robots-check.quietworklabs.workers.dev/mcp",
      "enabled": true
    }
  }
}

{
  "mcpServers": {
    "robots-check": {
      "type": "http",
      "url": "https://robots-check.quietworklabs.workers.dev/mcp"
    }
  },
  "deeplink": "cursor://anysphere.cursor-deeplink/mcp/install?name=robots-check&config=eyJ0eXBlIjoiaHR0cCIsInVybCI6Imh0dHBzOi8vcm9ib3RzLWNoZWNrLnF1aWV0d29ya2xhYnMud29ya2Vycy5kZXYvbWNwIn0%3D"
}

{
  "servers": {
    "robots-check": {
      "type": "http",
      "url": "https://robots-check.quietworklabs.workers.dev/mcp"
    }
  }
}

{
  "mcpServers": {
    "robots-check": {
      "httpUrl": "https://robots-check.quietworklabs.workers.dev/mcp"
    }
  }
}

extensions:
  "robots-check":
    enabled: true
    name: "robots-check"
    type: streamable_http
    uri: "https://robots-check.quietworklabs.workers.dev/mcp"
    timeout: 300

Quality 81 / 100new

protocol75 · weight 25

warn
protocol.modernnewest supported version is 2025-11-25; 2026-07-28 not supported, older versions are deprecated until 2027-07-28
n/a
protocol.statelessonly applies to 2026-07-28 servers
pass
protocol.transportstreamable HTTP
n/a
protocol.list_ttlonly applies to 2026-07-28 servers

authorizationn/a · weight 15

n/a
auth.prm, auth.as_metadata, auth.cimdno remote uses OAuth
n/a
auth.secret_in_urlno templated URL

tool hygiene86 · weight 30

pass
tools.descriptionsevery tool has a description
pass
tools.description_lengthdescriptions are concise
pass
tools.schemasevery tool has an object input schema
pass
tools.annotations3 of 3 tools declare readOnlyHint or destructiveHint
fail
tools.directory_hintsno tool declares all four of readOnlyHint, destructiveHint, idempotentHint and openWorldHint; missing: ai_crawler_access (destructiveHint, idempotentHint); sitemap_check (destructiveHint, idempotentHint); robots_check (destructiveHint, idempotentHint)
pass
tools.token_costabout 531 tokens to load every tool
pass
tools.api_dumptools are not a one-to-one API dump

stabilityn/a · weight 15

n/a
stability.changes, stability.rug_pulltool history recorded for 2 of the 7 days needed

dependenciesn/a · weight 15

n/a
deps.known_vulns, deps.mcp_sdk_version, deps.resolvableno npm or PyPI package

3 tools, about 531 tokens to load them all · tool set 4ced175fa110 · checked 2026-10-20 12:45 UTC

Tool changes

No tool definition changes recorded. A server's first observation is its baseline; later probes record what changes.

Checks run on what our credential-free, read-only probes observe; tools are never called and no code audit is performed. How it is computed.

Trust 81 / 100

no-repository

provenance55

liveness96

freshness100

hygiene80

+dns-namespace +website +reachable +uptime-89% +updated-2d-ago -no-repository

Derived from observable signals (official registry feed and our own credential-free probes); no code audit performed. How it is computed.

Endpoints

remote	auth	reachable	uptime 30d	p50	protocol	last ok
`https://robots-check.quietworklabs.workers.dev/mcp` streamable-http	none	yes	89%	208 ms	2025-11-25	2026-10-20

Tools (3)

`ai_crawler_access`read-only	AI crawler access report for a URL: robots.txt verdict for 20 tokens (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, Google-Extended, Applebot-Extended, PerplexityBot, Meta-ExternalAgent, CCBot, Bytespider, Amazonbot and more) grouped by training/search/user purpose, plus page meta robots, X-Robots-Tag (noindex/noai) and llms.txt presence. Deterministic, no AI. Price: $0.002 USDC per call via x402 (Base); the first 5 calls per day per client are free.
`robots_check`read-only	Crawl-permission preflight for agents and scrapers: fetches the site's robots.txt and evaluates the URL for a user-agent token per RFC 9309 (group by product token else , longest match, Allow wins ties, and $ wildcards, 4xx=allow all, 5xx=disallow all). Returns allowed, the deciding rule and line, crawl-delay and sitemaps. Deterministic, no AI. Price: $0.001 USDC per call via x402 (Base); the first 5 calls per day per client are free.
`sitemap_check`read-only	Finds a site's sitemap (from robots.txt, else /sitemap.xml) or checks the sitemap URL given, and validates it: urlset vs sitemapindex, entry count against the 50,000 limit, lastmod format and range, relative/off-host/duplicate/http URLs, gzip support. Returns sample URLs or child sitemaps. Deterministic, no AI. Price: $0.002 USDC per call via x402 (Base); the first 5 calls per day per client are free.

Schemas: list_tools.

Similar MCP servers

Official server.json

{
  "name": "dev.workers.quietworklabs.robots-check/robots-check",
  "title": "Robots.txt & AI Crawler Checker",
  "$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
  "remotes": [
    {
      "url": "https://robots-check.quietworklabs.workers.dev/mcp",
      "type": "streamable-http"
    }
  ],
  "version": "1.0.0",
  "websiteUrl": "https://robots-check.quietworklabs.workers.dev/",
  "description": "robots.txt tester (RFC 9309), AI crawler access (GPTBot, ClaudeBot...) and sitemap check."
}