protogrid

Search / dev.agentreliability/agent-reliability

Agent Reliability

R0· no sign-in

Testing, benchmarking and auditing autonomous AI agents — methods, harnesses, evidence

v0.6.14 · active · repository · descriptor JSON · versions

An agent can connect right now, no human step.Remote endpoint, no authentication, reachable on the last probe.
Quality100strong
Trust90of 100
Uptime, 30 days100%
Latency p501130 ms

Connect

8 clients · secrets stay placeholders
{
  "mcpServers": {
    "agent-reliability": {
      "type": "http",
      "url": "https://agentreliability.dev/mcp?via=manifest"
    }
  }
}
claude mcp add --transport http agent-reliability https://agentreliability.dev/mcp?via=manifest
[mcp_servers.agent-reliability]
url = "https://agentreliability.dev/mcp?via=manifest"
{
  "$schema": "https://opencode.ai/config.json",
  "mcp": {
    "agent-reliability": {
      "type": "remote",
      "url": "https://agentreliability.dev/mcp?via=manifest",
      "enabled": true
    }
  }
}
{
  "mcpServers": {
    "agent-reliability": {
      "type": "http",
      "url": "https://agentreliability.dev/mcp?via=manifest"
    }
  },
  "deeplink": "cursor://anysphere.cursor-deeplink/mcp/install?name=agent-reliability&config=eyJ0eXBlIjoiaHR0cCIsInVybCI6Imh0dHBzOi8vYWdlbnRyZWxpYWJpbGl0eS5kZXYvbWNwP3ZpYT1tYW5pZmVzdCJ9"
}
{
  "servers": {
    "agent-reliability": {
      "type": "http",
      "url": "https://agentreliability.dev/mcp?via=manifest"
    }
  }
}
{
  "mcpServers": {
    "agent-reliability": {
      "httpUrl": "https://agentreliability.dev/mcp?via=manifest"
    }
  }
}
extensions:
  "agent-reliability":
    enabled: true
    name: "agent-reliability"
    type: streamable_http
    uri: "https://agentreliability.dev/mcp?via=manifest"
    timeout: 300

Quality 100 / 100strong

protocol100 · weight 25
  • pass
    protocol.modernsupports 2026-07-28 (server/discover)
  • pass
    protocol.statelessanswers without a session
  • pass
    protocol.transportstreamable HTTP
  • pass
    protocol.list_ttltool list is cacheable (ttlMs 3600000)
authorizationn/a · weight 15
  • n/a
    auth.prm, auth.as_metadata, auth.cimdno remote uses OAuth
  • n/a
    auth.secret_in_urlno templated URL
tool hygiene100 · weight 30
  • pass
    tools.descriptionsevery tool has a description
  • pass
    tools.description_lengthdescriptions are concise
  • pass
    tools.schemasevery tool has an object input schema
  • pass
    tools.annotations9 of 9 tools declare readOnlyHint or destructiveHint
  • pass
    tools.directory_hintsevery tool declares readOnlyHint, destructiveHint, idempotentHint and openWorldHint
  • pass
    tools.token_costabout 2,258 tokens to load every tool
  • pass
    tools.api_dumptools are not a one-to-one API dump
stability100 · weight 15
  • pass
    stability.changesno tool changes in 30 days
  • pass
    stability.rug_pullno tool changed its meaning under the same name
dependenciesn/a · weight 15
  • n/a
    deps.known_vulns, deps.mcp_sdk_version, deps.resolvableno npm or PyPI package

9 tools, about 2,258 tokens to load them all · tool set 10529ccfbf80 · checked 2026-10-19 11:27 UTC

Tool changes

No tool definition changes recorded. A server's first observation is its baseline; later probes record what changes.

Checks run on what our credential-free, read-only probes observe; tools are never called and no code audit is performed. How it is computed.

Trust 90 / 100

provenance75
liveness100
freshness85
hygiene100

+repository +dns-namespace +reachable +uptime-100% ~updated-57d-ago

Derived from observable signals (official registry feed and our own credential-free probes); no code audit performed. How it is computed.

Endpoints

remoteauthreachableuptime 30dp50protocollast ok
https://agentreliability.dev/mcp?via=manifest streamable-httpnoneyes100%1130 ms2026-07-282026-10-19

Tools (9)

answerread-onlyAnswer a question from the corpus, or refuse. Returns only the claims that bear on the question, each with the sources it cites and its editorial confidence. When the corpus cannot answer, answered is false and abstention_reason plus missing_topics say what was not covered — a refusal is a real result here, not an error. Use this when the user asked a question in words; use search when you want to see the candidates yourself.
compareread-onlyTwo to six knowledge objects side by side: their cards, every indexed attribute as a matrix (the same fields api/index.json publishes, null where an object does not say), the tags they share, the relations that run between them, the neighbours they have in common, and each one's claims with sources and confidence. Use this when the question is 'X vs Y', 'is X the same as Y' or 'how does X differ from Y' — search or get_topic first if you only have names, then pass the ids. An unknown id lands in `missing` with a near-miss suggestion and the rest are still compared.
get_entityread-onlyFetch one knowledge object by id, with its claims and the sources each claim cites. Use this once search, answer or get_topic has given you an id. An unknown id is not a dead end: the answer names near-miss ids you can retry with.
get_latestread-onlyMost recently verified knowledge objects (freshness signal). Use this to judge how current the corpus is, or to see what changed since you last read it. It ranks by verification date and ignores your topic entirely — use search or get_topic when you want objects that are relevant rather than recent.
get_overviewread-onlyCorpus overview: what this instance knows, counts by type, published tags, freshness. Use this first when you land here and do not yet know whether this corpus can answer your question.
get_relatedread-onlyGraph neighbours of an object: outgoing and incoming relations, each with its relation type. PAGED: 25 relations by default, 200 at most, and a response budget of about 64 KB per call — a page over budget comes back shorter WITH a next_cursor, never truncated. One cursor walks both directions, outgoing first; its absence means you have the last page. Use this after get_entity to widen an answer with adjacent objects. It walks one hop from an id you already have — use search when you have a question and no starting object.
get_sourcesread-onlyThe instance's source registry — each entry with its evidence tier, reliability and access date. PAGED: 25 entries by default, 200 at most, and a response budget of about 64 KB per call — a page over budget comes back shorter WITH a next_cursor, never truncated. Read next_cursor and call again to continue; its absence means you have the last page. Filter by object_id, tier, host or accessed_since to avoid paging through a registry you do not need. Use this when you need the registry entry behind a citation, or a sample of the whole registry to judge the corpus before trusting it; get_entity already tells you which sources a claim cites.
get_topicread-onlyList the knowledge objects carrying a tag (topics are content-backed tags). PAGED: 25 objects by default, 200 at most, and a response budget of about 64 KB per call — a page over budget comes back shorter WITH a next_cursor, never truncated. Read next_cursor and call again to continue, and its absence means you have the last page. Use this to browse a known topic; use search when you have a question rather than a tag, and get_overview to see which tags exist. An unknown tag comes back with the topics that do exist, so a miss still moves you forward.
searchread-onlyFull-text search over the knowledge graph. Matching ignores accents and apostrophes, so query in the user's own words; every hit carries the fields it matched and a score. BM25 relevance: each query term is weighted by how RARE it is in this corpus and by where it hits (name 3, tags 2, questions 2, body 1). A hit must also cover a minimum share of the question's information, measured in the same rarity weights — matching only common words does not qualify. Centrality (how many objects point at this one) breaks TIES ONLY and is never part of the score, so it cannot make an irrelevant object rank. Two hits with the same matched_fields can still differ: the score is rarity-weighted, so matching a rare term is worth more than matching a common one. Use this whenever you have a question rather than an id, then follow up with get_entity.

Schemas: list_tools.

Similar MCP servers

Official server.json
{
  "name": "dev.agentreliability/agent-reliability",
  "title": "Agent Reliability",
  "$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
  "remotes": [
    {
      "url": "https://agentreliability.dev/mcp?via=manifest",
      "type": "streamable-http"
    }
  ],
  "version": "0.6.14",
  "repository": {
    "url": "https://github.com/citarium/agentreliability-mcp",
    "source": "github"
  },
  "description": "Testing, benchmarking and auditing autonomous AI agents — methods, harnesses, evidence"
}