Search / io.github.hamzawamiqhq/ai-crawler-check
protogridR0· no sign-inCan GPTBot, ClaudeBot and PerplexityBot reach a site? Real fetch per crawler, firewall/CDN blocks.
v1.0.0 · active · website · descriptor JSON · versions
{
"mcpServers": {
"ai-crawler-check": {
"type": "http",
"url": "https://check.citant.ai/mcp?src=registry"
}
}
}claude mcp add --transport http ai-crawler-check https://check.citant.ai/mcp?src=registry[mcp_servers.ai-crawler-check]
url = "https://check.citant.ai/mcp?src=registry"
{
"$schema": "https://opencode.ai/config.json",
"mcp": {
"ai-crawler-check": {
"type": "remote",
"url": "https://check.citant.ai/mcp?src=registry",
"enabled": true
}
}
}{
"mcpServers": {
"ai-crawler-check": {
"type": "http",
"url": "https://check.citant.ai/mcp?src=registry"
}
},
"deeplink": "cursor://anysphere.cursor-deeplink/mcp/install?name=ai-crawler-check&config=eyJ0eXBlIjoiaHR0cCIsInVybCI6Imh0dHBzOi8vY2hlY2suY2l0YW50LmFpL21jcD9zcmM9cmVnaXN0cnkifQ%3D%3D"
}{
"servers": {
"ai-crawler-check": {
"type": "http",
"url": "https://check.citant.ai/mcp?src=registry"
}
}
}{
"mcpServers": {
"ai-crawler-check": {
"httpUrl": "https://check.citant.ai/mcp?src=registry"
}
}
}extensions:
"ai-crawler-check":
enabled: true
name: "ai-crawler-check"
type: streamable_http
uri: "https://check.citant.ai/mcp?src=registry"
timeout: 300
protocol.modernnewest supported version is 2025-06-18; 2026-07-28 not supported, older versions are deprecated until 2027-07-28protocol.statelessonly applies to 2026-07-28 serversprotocol.transportstreamable HTTPprotocol.list_ttlonly applies to 2026-07-28 serversauth.prm, auth.as_metadata, auth.cimdno remote uses OAuthauth.secret_in_urlno templated URLtools.descriptionsevery tool has a descriptiontools.description_lengthdescriptions are concisetools.schemasevery tool has an object input schematools.annotations1 of 1 tools declare readOnlyHint or destructiveHinttools.directory_hintsevery tool declares readOnlyHint, destructiveHint, idempotentHint and openWorldHinttools.token_costabout 182 tokens to load every tooltools.api_dumptools are not a one-to-one API dumpstability.changesno tool changes in 30 daysstability.rug_pullno tool changed its meaning under the same namedeps.known_vulns, deps.mcp_sdk_version, deps.resolvableno npm or PyPI packageNo tool definition changes recorded. A server's first observation is its baseline; later probes record what changes.
Checks run on what our credential-free, read-only probes observe; tools are never called and no code audit is performed. How it is computed.
+website +reachable +uptime-100% +updated-14d-ago -no-repository
Derived from observable signals (official registry feed and our own credential-free probes); no code audit performed. How it is computed.
| remote | auth | reachable | uptime 30d | p50 | protocol | last ok |
|---|---|---|---|---|---|---|
https://check.citant.ai/mcp?src=registry streamable-http | none | yes | 100% | 444 ms | 2025-06-18 | 2026-10-20 |
check_ai_crawler_accessread-only | Checks whether AI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended and others) can actually reach a website. Goes beyond robots.txt: fetches the site as each crawler and detects firewall/CDN blocks (Cloudflare, Akamai, Imperva), challenge pages, noindex and llms.txt. Returns a 0-100 AI Access Score, a per-crawler verdict and the top issues with fixes. Takes 15-60 seconds. |
Schemas: list_tools.
{
"name": "io.github.hamzawamiqhq/ai-crawler-check",
"title": "AI Crawler Access Check",
"$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
"remotes": [
{
"url": "https://check.citant.ai/mcp?src=registry",
"type": "streamable-http"
}
],
"version": "1.0.0",
"websiteUrl": "https://check.citant.ai/",
"description": "Can GPTBot, ClaudeBot and PerplexityBot reach a site? Real fetch per crawler, firewall/CDN blocks."
}