Search / io.github.giachi85it-ux/mcp-judge
mcp-judge
not classifiedScores any MCP server before you trust it: free quick check, full paid report, 2-5 way compare.
v0.2.0 · active · descriptor JSON · versions
Search / io.github.giachi85it-ux/mcp-judge
Scores any MCP server before you trust it: free quick check, full paid report, 2-5 way compare.
v0.2.0 · active · descriptor JSON · versions
{
"mcpServers": {
"mcp-judge": {
"type": "http",
"url": "https://mcp-judge.onrender.com/mcp"
}
}
}claude mcp add --transport http mcp-judge https://mcp-judge.onrender.com/mcp[mcp_servers.mcp-judge]
url = "https://mcp-judge.onrender.com/mcp"
{
"$schema": "https://opencode.ai/config.json",
"mcp": {
"mcp-judge": {
"type": "remote",
"url": "https://mcp-judge.onrender.com/mcp",
"enabled": true
}
}
}{
"mcpServers": {
"mcp-judge": {
"type": "http",
"url": "https://mcp-judge.onrender.com/mcp"
}
},
"deeplink": "cursor://anysphere.cursor-deeplink/mcp/install?name=mcp-judge&config=eyJ0eXBlIjoiaHR0cCIsInVybCI6Imh0dHBzOi8vbWNwLWp1ZGdlLm9ucmVuZGVyLmNvbS9tY3AifQ%3D%3D"
}{
"servers": {
"mcp-judge": {
"type": "http",
"url": "https://mcp-judge.onrender.com/mcp"
}
}
}{
"mcpServers": {
"mcp-judge": {
"httpUrl": "https://mcp-judge.onrender.com/mcp"
}
}
}extensions:
"mcp-judge":
enabled: true
name: "mcp-judge"
type: streamable_http
uri: "https://mcp-judge.onrender.com/mcp"
timeout: 300
protocol.modernnewest supported version is 2025-11-25; 2026-07-28 not supported, older versions are deprecated until 2027-07-28protocol.statelessonly applies to 2026-07-28 serversprotocol.transportstreamable HTTPprotocol.list_ttlonly applies to 2026-07-28 serversauth.prm, auth.as_metadata, auth.cimdno remote uses OAuthauth.secret_in_urlno templated URLtools.descriptionsevery tool has a descriptiontools.description_length1 tools have descriptions over 1,024 characters, which crowds the contexttools.schemasevery tool has an object input schematools.annotationsno tool declares readOnlyHint or destructiveHint, so clients cannot tell safe calls from risky onestools.directory_hintsno tool declares all four of readOnlyHint, destructiveHint, idempotentHint and openWorldHint; missing: list_criteria (readOnlyHint, destructiveHint, idempotentHint, openWorldHint); compare_mcps (readOnlyHint, destructiveHint, idempotentHint, openWorldHint); evaluate_mcp (readOnlyHint, destructiveHint, idempotentHint, openWorldHint); …tools.token_costabout 1,015 tokens to load every tooltools.api_dumptools are not a one-to-one API dumpstability.changesno tool changes in 30 daysstability.rug_pullno tool changed its meaning under the same namedeps.known_vulns, deps.mcp_sdk_version, deps.resolvableno npm or PyPI packageNo tool definition changes recorded. A server's first observation is its baseline; later probes record what changes.
Checks run on what our credential-free, read-only probes observe; tools are never called and no code audit is performed. How it is computed.
-unreachable(5 failures) ~updated-103d-ago -no-repository
Derived from observable signals (official registry feed and our own credential-free probes); no code audit performed. How it is computed.
| remote | auth | reachable | uptime 30d | p50 | protocol | last ok |
|---|---|---|---|---|---|---|
https://mcp-judge.onrender.com/mcp streamable-http | none | no (5 failures) | 73% | 331 ms | 2025-11-25 | 2026-10-11 |
compare_mcps | Choosing between several MCP servers that do similar things? This tool decides for you. PAID $0.10 via x402 (USDC micropayment over HTTP 402 — no account or API key needed; on your first call without payment you receive the exact payment requirements, then retry with the X-PAYMENT header). Compares 2-5 MCP servers head-to-head with identical objective checks (handshake, tools/list, documentation coverage, latency, and a safe functional probe — paid tools are never called) and returns: a ranked list, the recommended winner, a plain-language explanation of why it won, and each server's full report — cheaper than separate evaluate_mcp calls on 3+ servers. Objective checks only — no human and no LLM opinion; it does not judge the real-world usefulness or safety of the content. Set 'urls' (required) to an array of 2-5 MCP endpoints (Streamable HTTP), e.g. ["https://a/mcp","https://b/mcp"]. |
evaluate_mcp | Call this BEFORE integrating any third-party MCP server: an unreliable or undocumented MCP wastes your tokens and can break your workflow. PAID $0.05 via x402 (USDC micropayment over HTTP 402 — no account or API key needed; on your first call without payment you receive the exact payment requirements, then retry with the X-PAYMENT header). Returns a complete objective quality report on the target: protocol conformance ('initialize' handshake), tool discovery via 'tools/list', per-tool and per-parameter documentation coverage, latency, and a safe functional probe — free tools are actually called, paid tools are only verified to be cleanly declared (MCP Judge never pays). You get a 0-100 score, A-F letter grade, per-criterion breakdown, and a plain-language summary you can act on. Tip: run the FREE quick_check first to get just the grade, and list_criteria to see exactly how scoring works. Objective checks only — no human and no LLM opinion; it does not judge the real-world usefulness or safety of the content. Set 'url' (required) to the target's MCP endpoint (Streamable HTTP), e.g. https://host/mcp. |
list_criteria | FREE, no payment required. Full transparency into what you pay for: returns the exact criteria MCP Judge uses to score an MCP server — each criterion, its weight out of 100, and the A-F grade scale. Call this to understand how quick_check, evaluate_mcp and compare_mcps score targets before paying. The evaluation is fully objective and automated — no human reviewer and no AI opinion. Takes no parameters. |
quick_check | FREE, no payment required. Instant trust check of any MCP server: returns only the 0-100 score, A-F grade, tool count, latency and a one-line verdict — no detailed report. Use this FIRST, before integrating any third-party MCP server, to see at a glance whether it is technically trustworthy; an unreliable MCP wastes your tokens and can break your workflow. For the full actionable report (per-tool documentation coverage, functional probe results, score breakdown, plain-language summary) call evaluate_mcp; to pick between alternatives call compare_mcps. Set 'url' (required) to the target's MCP endpoint (Streamable HTTP), e.g. https://host/mcp. |
Schemas: list_tools.
{
"name": "io.github.giachi85it-ux/mcp-judge",
"$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
"remotes": [
{
"url": "https://mcp-judge.onrender.com/mcp",
"type": "streamable-http"
}
],
"version": "0.2.0",
"repository": {},
"description": "Scores any MCP server before you trust it: free quick check, full paid report, 2-5 way compare."
}