Search / dev.agentreliability/agent-reliability
Agent Reliability
R0· no sign-inTesting, benchmarking and auditing autonomous AI agents — methods, harnesses, evidence
v0.6.14 · active · repository · descriptor JSON · versions
Search / dev.agentreliability/agent-reliability
R0· no sign-inTesting, benchmarking and auditing autonomous AI agents — methods, harnesses, evidence
v0.6.14 · active · repository · descriptor JSON · versions
{
"mcpServers": {
"agent-reliability": {
"type": "http",
"url": "https://agentreliability.dev/mcp?via=manifest"
}
}
}claude mcp add --transport http agent-reliability https://agentreliability.dev/mcp?via=manifest[mcp_servers.agent-reliability]
url = "https://agentreliability.dev/mcp?via=manifest"
{
"$schema": "https://opencode.ai/config.json",
"mcp": {
"agent-reliability": {
"type": "remote",
"url": "https://agentreliability.dev/mcp?via=manifest",
"enabled": true
}
}
}{
"mcpServers": {
"agent-reliability": {
"type": "http",
"url": "https://agentreliability.dev/mcp?via=manifest"
}
},
"deeplink": "cursor://anysphere.cursor-deeplink/mcp/install?name=agent-reliability&config=eyJ0eXBlIjoiaHR0cCIsInVybCI6Imh0dHBzOi8vYWdlbnRyZWxpYWJpbGl0eS5kZXYvbWNwP3ZpYT1tYW5pZmVzdCJ9"
}{
"servers": {
"agent-reliability": {
"type": "http",
"url": "https://agentreliability.dev/mcp?via=manifest"
}
}
}{
"mcpServers": {
"agent-reliability": {
"httpUrl": "https://agentreliability.dev/mcp?via=manifest"
}
}
}extensions:
"agent-reliability":
enabled: true
name: "agent-reliability"
type: streamable_http
uri: "https://agentreliability.dev/mcp?via=manifest"
timeout: 300
protocol.modernsupports 2026-07-28 (server/discover)protocol.statelessanswers without a sessionprotocol.transportstreamable HTTPprotocol.list_ttltool list is cacheable (ttlMs 3600000)auth.prm, auth.as_metadata, auth.cimdno remote uses OAuthauth.secret_in_urlno templated URLtools.descriptionsevery tool has a descriptiontools.description_lengthdescriptions are concisetools.schemasevery tool has an object input schematools.annotations9 of 9 tools declare readOnlyHint or destructiveHinttools.directory_hintsevery tool declares readOnlyHint, destructiveHint, idempotentHint and openWorldHinttools.token_costabout 2,258 tokens to load every tooltools.api_dumptools are not a one-to-one API dumpstability.changesno tool changes in 30 daysstability.rug_pullno tool changed its meaning under the same namedeps.known_vulns, deps.mcp_sdk_version, deps.resolvableno npm or PyPI packageNo tool definition changes recorded. A server's first observation is its baseline; later probes record what changes.
Checks run on what our credential-free, read-only probes observe; tools are never called and no code audit is performed. How it is computed.
+repository +dns-namespace +reachable +uptime-100% ~updated-57d-ago
Derived from observable signals (official registry feed and our own credential-free probes); no code audit performed. How it is computed.
| remote | auth | reachable | uptime 30d | p50 | protocol | last ok |
|---|---|---|---|---|---|---|
https://agentreliability.dev/mcp?via=manifest streamable-http | none | yes | 100% | 1130 ms | 2026-07-28 | 2026-10-19 |
answerread-only | Answer a question from the corpus, or refuse. Returns only the claims that bear on the question, each with the sources it cites and its editorial confidence. When the corpus cannot answer, answered is false and abstention_reason plus missing_topics say what was not covered — a refusal is a real result here, not an error. Use this when the user asked a question in words; use search when you want to see the candidates yourself. |
compareread-only | Two to six knowledge objects side by side: their cards, every indexed attribute as a matrix (the same fields api/index.json publishes, null where an object does not say), the tags they share, the relations that run between them, the neighbours they have in common, and each one's claims with sources and confidence. Use this when the question is 'X vs Y', 'is X the same as Y' or 'how does X differ from Y' — search or get_topic first if you only have names, then pass the ids. An unknown id lands in `missing` with a near-miss suggestion and the rest are still compared. |
get_entityread-only | Fetch one knowledge object by id, with its claims and the sources each claim cites. Use this once search, answer or get_topic has given you an id. An unknown id is not a dead end: the answer names near-miss ids you can retry with. |
get_latestread-only | Most recently verified knowledge objects (freshness signal). Use this to judge how current the corpus is, or to see what changed since you last read it. It ranks by verification date and ignores your topic entirely — use search or get_topic when you want objects that are relevant rather than recent. |
get_overviewread-only | Corpus overview: what this instance knows, counts by type, published tags, freshness. Use this first when you land here and do not yet know whether this corpus can answer your question. |
get_relatedread-only | Graph neighbours of an object: outgoing and incoming relations, each with its relation type. PAGED: 25 relations by default, 200 at most, and a response budget of about 64 KB per call — a page over budget comes back shorter WITH a next_cursor, never truncated. One cursor walks both directions, outgoing first; its absence means you have the last page. Use this after get_entity to widen an answer with adjacent objects. It walks one hop from an id you already have — use search when you have a question and no starting object. |
get_sourcesread-only | The instance's source registry — each entry with its evidence tier, reliability and access date. PAGED: 25 entries by default, 200 at most, and a response budget of about 64 KB per call — a page over budget comes back shorter WITH a next_cursor, never truncated. Read next_cursor and call again to continue; its absence means you have the last page. Filter by object_id, tier, host or accessed_since to avoid paging through a registry you do not need. Use this when you need the registry entry behind a citation, or a sample of the whole registry to judge the corpus before trusting it; get_entity already tells you which sources a claim cites. |
get_topicread-only | List the knowledge objects carrying a tag (topics are content-backed tags). PAGED: 25 objects by default, 200 at most, and a response budget of about 64 KB per call — a page over budget comes back shorter WITH a next_cursor, never truncated. Read next_cursor and call again to continue, and its absence means you have the last page. Use this to browse a known topic; use search when you have a question rather than a tag, and get_overview to see which tags exist. An unknown tag comes back with the topics that do exist, so a miss still moves you forward. |
searchread-only | Full-text search over the knowledge graph. Matching ignores accents and apostrophes, so query in the user's own words; every hit carries the fields it matched and a score. BM25 relevance: each query term is weighted by how RARE it is in this corpus and by where it hits (name 3, tags 2, questions 2, body 1). A hit must also cover a minimum share of the question's information, measured in the same rarity weights — matching only common words does not qualify. Centrality (how many objects point at this one) breaks TIES ONLY and is never part of the score, so it cannot make an irrelevant object rank. Two hits with the same matched_fields can still differ: the score is rarity-weighted, so matching a rare term is worth more than matching a common one. Use this whenever you have a question rather than an id, then follow up with get_entity. |
Schemas: list_tools.
{
"name": "dev.agentreliability/agent-reliability",
"title": "Agent Reliability",
"$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
"remotes": [
{
"url": "https://agentreliability.dev/mcp?via=manifest",
"type": "streamable-http"
}
],
"version": "0.6.14",
"repository": {
"url": "https://github.com/citarium/agentreliability-mcp",
"source": "github"
},
"description": "Testing, benchmarking and auditing autonomous AI agents — methods, harnesses, evidence"
}