protogrid

Search / dev.workers.pathwren.www/crawler-ip-verifier

Crawler IP Verifier - real Googlebot or fake

not classified

{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key

v1.4.0 · active · website · descriptor JSON · versions

Not classified yet.The remote endpoints have not been probed successfully, or the listing has nothing to connect to.
Quality97good
Trust58of 100
Uptime, 30 days96%
Latency p50264 ms

Connect

8 clients · secrets stay placeholders
{
  "mcpServers": {
    "crawler-ip-verifier": {
      "type": "http",
      "url": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/netcheck"
    }
  }
}
claude mcp add --transport http crawler-ip-verifier https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/netcheck
[mcp_servers.crawler-ip-verifier]
url = "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/netcheck"
{
  "$schema": "https://opencode.ai/config.json",
  "mcp": {
    "crawler-ip-verifier": {
      "type": "remote",
      "url": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/netcheck",
      "enabled": true
    }
  }
}
{
  "mcpServers": {
    "crawler-ip-verifier": {
      "type": "http",
      "url": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/netcheck"
    }
  },
  "deeplink": "cursor://anysphere.cursor-deeplink/mcp/install?name=crawler-ip-verifier&config=eyJ0eXBlIjoiaHR0cCIsInVybCI6Imh0dHBzOi8vd3d3LnBhdGh3cmVuLndvcmtlcnMuZGV2L2MvbWNwLXJlZ2lzdHJ5LW9mZmljaWFsL21jcC9uZXRjaGVjayJ9"
}
{
  "servers": {
    "crawler-ip-verifier": {
      "type": "http",
      "url": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/netcheck"
    }
  }
}
{
  "mcpServers": {
    "crawler-ip-verifier": {
      "httpUrl": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/netcheck"
    }
  }
}
extensions:
  "crawler-ip-verifier":
    enabled: true
    name: "crawler-ip-verifier"
    type: streamable_http
    uri: "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/netcheck"
    timeout: 300

Quality 97 / 100good

protocol100 · weight 25
  • pass
    protocol.modernsupports 2026-07-28 (server/discover)
  • pass
    protocol.statelessanswers without a session
  • pass
    protocol.transportstreamable HTTP
  • pass
    protocol.list_ttltool list is cacheable (ttlMs 3600000)
authorizationn/a · weight 15
  • n/a
    auth.prm, auth.as_metadata, auth.cimdno remote uses OAuth
  • n/a
    auth.secret_in_urlno templated URL
tool hygiene93 · weight 30
  • pass
    tools.descriptionsevery tool has a description
  • warn
    tools.description_length4 tools have descriptions over 1,024 characters, which crowds the context
  • pass
    tools.schemasevery tool has an object input schema
  • pass
    tools.annotations9 of 9 tools declare readOnlyHint or destructiveHint
  • pass
    tools.directory_hintsevery tool declares readOnlyHint, destructiveHint, idempotentHint and openWorldHint
  • pass
    tools.token_costabout 3,236 tokens to load every tool
  • pass
    tools.api_dumptools are not a one-to-one API dump
stability100 · weight 15
  • pass
    stability.changesno tool changes in 30 days
  • pass
    stability.rug_pullno tool changed its meaning under the same name
dependenciesn/a · weight 15
  • n/a
    deps.known_vulns, deps.mcp_sdk_version, deps.resolvableno npm or PyPI package

9 tools, about 3,236 tokens to load them all · tool set f66f6a74e7c6 · checked 2026-10-20 13:17 UTC

Tool changes

No tool definition changes recorded. A server's first observation is its baseline; later probes record what changes.

Checks run on what our credential-free, read-only probes observe; tools are never called and no code audit is performed. How it is computed.

Trust 58 / 100

no-repository
provenance55
liveness28
freshness85
hygiene80

+dns-namespace +website -unreachable(1 failures) ~updated-44d-ago -no-repository

Derived from observable signals (official registry feed and our own credential-free probes); no code audit performed. How it is computed.

Endpoints

remoteauthreachableuptime 30dp50protocollast ok
https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/netcheck streamable-httpnoneno (1 failures)96%264 ms2026-07-28, 2025-11-25, 2025-06-18, 2025-03-26, 2024-11-052026-10-20

Tools (9)

exampleread-only{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"example","arguments":{}}} — POST that exact body to https://www.pathwren.workers.dev/mcp/netcheck and you are done: free, read-only, no API key, no account, no consent prompt, nothing for you to invent, and what comes back is this server's own worked example — verify_batch, run for real on a canned input from this host's own data — so you see the exact shape of an answer before you send anything of yours. Takes no arguments. Safe to call. Deterministic. Touches no third party. Runs this server's own worked example end to end — verify_batch on one address from inside a prefix Google itself publishes (mirrored here every six hours) and one RFC 5737 documentation address that is in no published range — our own mirror, no third party asked — and returns exactly the structuredContent a real call returns, not a mock and not a description of one. Use it to see the shape of an answer before you decide what to send. The input is canned from this host's own data; no URL of yours is fetched and no third party is touched. Example: arguments={} runs verify_batch with {"addresses":[{"ip":"66.249.66.1","claim":"Googlebot"},{"ip":"203.0.113.9","claim":"GPTBot and returns its real answer.
export_ip_aclread-onlyFIRST CALL, needs nothing: {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"no_arguments_report_the_crawler_ip_ranges_this_host_mirrors","arguments":{}}} — Turn a set of operators into a config you can paste: nginx geo, nginx allow/deny, Apache, HAProxy, a Cloudflare firewall expression, an ipset script, a Caddy matcher, or a plain CIDR list. Every export carries a provenance header naming each source URL and the mirror time, and reports the rule cost. Example: operators='all', format='cidr-list', action='allow'.
lookup_prefixread-onlyFIRST CALL, needs nothing: {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"no_arguments_report_the_crawler_ip_ranges_this_host_mirrors","arguments":{}}} — Give a CIDR and get every published operator prefix that contains it, is contained by it, or partially overlaps it — the check for 'does my network collide with a crawler range' and for auditing an allowlist somebody handed you. Give an operator or source slug instead and get everything that source publishes. Example: cidr='66.249.66.0/24'.
no_arguments_report_the_crawler_ip_ranges_this_host_mirrorsread-onlyTAKES NO ARGUMENTS. POST {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"no_arguments_report_the_crawler_ip_ranges_this_host_mirrors","arguments":{}}} to https://www.pathwren.workers.dev/mcp/netcheck — the answer is the state of every crawler-operator prefix list this host mirrors — how many IPv4 and IPv6 prefixes each source publishes and how many addresses that is, when each was last fetched and how many minutes ago that was, which crawlers each source covers, which prefixes more than one operator claims, and the verification method each operator documents for the crawlers that publish no list at all. There is nothing to fill in: the input schema is literally empty, `arguments: {}` and no `arguments` key at all both work, and the subject is a file this host already publishes, so the answer does not depend on you at all. No key, no account, no OAuth, no session to open first, read-only, and nothing for you to invent. Nothing is fetched to build it — no request leaves this edge, and none is made to you. The other zero-argument call on this server is verify_my_address, same empty arguments, which answers the address you are calling from, checked against every operator-published prefix list this host mirrors with your user-agent taken as the claim — the verdict, the prefix that matched, which operator published it and when it was last mirrored. whoami and example are here too and take nothing either. Every other tool on this server wants a file pasted in; this one wants nothing. The siblings answer one question each under the tool named beside them: /mcp (whoami), /mcp/doctor (no_arguments_check_this_hosts_own_discovery_documents), /mcp/lint (whoami), /mcp/triage (no_arguments_triage_this_hosts_own_crawler_log), /mcp/robots (no_arguments_lint_this_hosts_robots_txt), /mcp/markdown (markdown_lane_self_report). Example: the complete call, exactly as written, nothing to fill in — {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"no_arguments_report_the_crawler_ip_ranges_this_host_mirrors","arguments":{}}} returns a row per source with its prefix counts, address total, fetch time and staleness in minutes, the prefixes published by two operators at once, and the split between operators you can verify by prefix and operators you can only verify by reverse DNS.
range_statsread-onlyTakes no arguments. Safe to call. Deterministic. Touches no third party. Per source: prefix counts, total addresses and /24-equivalents, smallest and largest prefix, the publishing URL and when it was last fetched; plus prefixes published by more than one operator. This is the sizing and freshness information an allowlist decision needs. Example: {} — no arguments at all.
verification_methodsread-onlyFIRST CALL, needs nothing: {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"no_arguments_report_the_crawler_ip_ranges_this_host_mirrors","arguments":{}}} — Per crawler: whether the operator publishes IP ranges, documents reverse DNS, or publishes no verification method at all — with the exact source URL or the exact dig commands, and how fresh this mirror is. Call it before reading anything into an address that matched nothing. Reverse DNS is never run here; the command is handed back instead. Example: crawler='claudebot'. Also callable without MCP, same implementation: GET https://www.pathwren.workers.dev/tools/verification-methods?crawler=claudebot&s=client-dossiers
verify_batchread-onlyFIRST CALL, needs nothing: {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"no_arguments_report_the_crawler_ip_ranges_this_host_mirrors","arguments":{}}} — Check up to 500 addresses against every mirrored operator prefix list in one call. Returns, per address, the matching prefix, the source that published it and when it was mirrored, plus a rollup by operator. Accepts {ip, claim} pairs to test a claimed identity against the ranges, and says plainly that a miss is not evidence of a fake. Example: addresses=[{ip:'66.249.66.1', claim:'Googlebot'}, {ip:'203.0.113.9', claim:'GPTBot'}] — the first matches a published Google prefix, the second matches nothing. Also callable without MCP, same implementation: GET https://www.pathwren.workers.dev/tools/verify-crawler?ip=66.249.66.1&ua=Googlebot&s=client-dossiers
verify_my_addressread-only{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"verify_my_address","arguments":{}}} — POST that exact body to https://www.pathwren.workers.dev/mcp/netcheck and the answer is the address you are calling from, checked against every operator-published prefix list this host mirrors with your user-agent taken as the claim — the verdict, the prefix that matched, which operator published it and when it was last mirrored. THIS IS THE CALL TO MAKE FIRST on this server: it is the only one whose subject is the request you just sent, so there is nothing to look up and no argument to invent. No key, no account, no OAuth, no session to open first, read-only, and nothing for you to invent. Every fact is computed from your own headers and from files this host already publishes; nothing is fetched to build it, and no URL of yours is touched. Only this server answers whether the address you are calling from falls inside a prefix a crawler operator publishes, and which prefix from which source — its six siblings answer one other question each about you, same empty arguments, each under the tool named beside its path: /mcp (whoami), /mcp/doctor (no_arguments_check_this_hosts_own_discovery_documents), /mcp/lint (whoami), /mcp/triage (no_arguments_triage_this_hosts_own_crawler_log), /mcp/robots (no_arguments_lint_this_hosts_robots_txt), /mcp/markdown (markdown_lane_self_report) on https://www.pathwren.workers.dev; whoami is answered by all seven and is never an error, so one identical body still walks the whole family if you prefer that. Example: the complete call, exactly as written, nothing to fill in — {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"verify_my_address","arguments":{}}} returns a verdict for the address you are calling from, the matching prefix with its source and mirror time, and the sentence that a miss is not evidence of a fake.
whoamiread-only{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} — POST that exact body to https://www.pathwren.workers.dev/mcp/netcheck and you are done: free, read-only, no API key, no account, no consent prompt, nothing for you to invent, and what comes back describes YOU, the caller — the user-agent you sent, the address you came from, the class our instrument books you as, and whether this host has seen you before. Takes no arguments. Safe to call. Deterministic. Touches no third party. Classifies the request you just sent: the user-agent you claim, the address you came from, the class this host's own instrument books you as, whether we have seen you here before and what you fetched, and whether the address you are calling from falls inside any prefix a crawler operator publishes — run through this server's own verify_batch, against the same mirror, with your user-agent taken as the claim. Every fact comes from the headers on your own request or from a file this host already publishes — nothing is fetched, nothing about you is invented, no argument exists. Example: arguments={} returns your user-agent, your address, the class we book you as and whether we have seen you here before.

Schemas: list_tools.

Similar MCP servers

More from dev.workers.pathwren.www

Official server.json
{
  "name": "dev.workers.pathwren.www/crawler-ip-verifier",
  "_meta": {
    "io.modelcontextprotocol.registry/publisher-provided": {
      "auth": "none",
      "docs": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp.html",
      "tools": [
        {
          "name": "whoami",
          "search": "who is calling: user-agent, address, our verdict - no arguments"
        },
        {
          "name": "verify_batch",
          "search": "verify up to 500 IPs against operator-published ranges"
        },
        {
          "name": "lookup_prefix",
          "search": "check whether a CIDR overlaps a published crawler range"
        },
        {
          "name": "export_ip_acl",
          "search": "export an nginx, Apache, HAProxy, ipset or Cloudflare allowlist"
        },
        {
          "name": "verification_methods",
          "search": "find out whether a crawler can be verified at all, and how"
        },
        {
          "name": "range_stats",
          "search": "see the state of the mirrored prefix lists"
        },
        {
          "name": "example",
          "search": "run the worked example — no arguments"
        }
      ],
      "example": {
        "curl": "curl -s -X POST https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/netcheck -H 'content-type: application/json' -H 'accept: application/json, text/event-stream' -d '{\"jsonrpc\":\"2.0\",\"id\":1,\"method\":\"tools/call\",\"params\":{\"name\":\"whoami\",\"arguments\":{}}}'",
        "note": "whoami takes no arguments at all and answers about the request you just sent - user-agent, address, what our classifier makes of it. Every tool here accepts {} and answers with its own documented worked example — nothing of yours is read, nothing is fetched from a third party. Send the request below verbatim.",
        "request": {
          "id": 1,
          "method": "tools/call",
          "params": {
            "name": "whoami",
            "arguments": {}
          },
          "jsonrpc": "2.0"
        },
        "endpoint": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/netcheck",
        "transport": "streamable-http",
        "verified_live_at": "2026-09-02T08:49:09Z"
      },
      "pricing": "free",
      "keywords": [
        "verify googlebot",
        "gptbot ip",
        "is this bot real",
        "ip allowlist",
        "firewall",
        "cidr lookup",
        "bot verification",
        "reverse dns",
        "nginx allow",
        "cloudflare firewall",
        "markdown",
        "markdown docs",
        "free",
        "no api key",
        "no auth"
      ],
      "markdown": {
        "note": "Everything this server answers from is also readable without JSON-RPC and without an MCP client: every page of the host is a plain markdown file at the same address with .md — also .mdx, <page>.html.md, <page>.html.mdx, or send Accept: text/markdown to the .html page. No key, no JavaScript, CC0. The registry caps `description` at 100 characters, which is why this sentence lives here.",
        "index": "https://www.pathwren.workers.dev/c/mcp-registry-official/sitemap.md",
        "example": "curl -s https://www.pathwren.workers.dev/c/mcp-registry-official/mcp-netcheck.md",
        "canonical": "the HTML page; each mirror carries Link: rel=\"canonical\" back to it"
      },
      "publisher": "Pathwren — an independent, non-commercial automated project",
      "dataLicense": "CC0-1.0",
      "authentication": "none — no key, no account, no OAuth, no rate limit"
    }
  },
  "icons": [
    {
      "src": "https://www.pathwren.workers.dev/c/mcp-registry-official/icon.png",
      "sizes": [
        "256x256"
      ],
      "mimeType": "image/png"
    }
  ],
  "title": "Crawler IP Verifier - real Googlebot or fake",
  "$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
  "remotes": [
    {
      "url": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/netcheck",
      "type": "streamable-http"
    }
  ],
  "version": "1.4.0",
  "websiteUrl": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp-netcheck.html",
  "description": "{\"jsonrpc\":\"2.0\",\"id\":1,\"method\":\"tools/call\",\"params\":{\"name\":\"whoami\",\"arguments\":{}}} free no key"
}