Search / io.github.HZYAI/ragscore
RAGScore
L0· runs locallyGenerate QA datasets & evaluate RAG systems with failure diagnosis. Any LLM.
v0.8.6 · active · repository · descriptor JSON · versions
Search / io.github.HZYAI/ragscore
L0· runs locallyGenerate QA datasets & evaluate RAG systems with failure diagnosis. Any LLM.
v0.8.6 · active · repository · descriptor JSON · versions
{
"mcpServers": {
"ragscore": {
"command": "uvx",
"args": [
"ragscore==0.8.6"
],
"env": {
"OPENAI_API_KEY": "${OPENAI_API_KEY}",
"ANTHROPIC_API_KEY": "${ANTHROPIC_API_KEY}"
}
}
}
}claude mcp add ragscore -e "OPENAI_API_KEY=${OPENAI_API_KEY}" -e "ANTHROPIC_API_KEY=${ANTHROPIC_API_KEY}" -- uvx ragscore==0.8.6[mcp_servers.ragscore]
command = "uvx"
args = ["ragscore==0.8.6"]
env = { "OPENAI_API_KEY" = "${OPENAI_API_KEY}", "ANTHROPIC_API_KEY" = "${ANTHROPIC_API_KEY}" }
{
"$schema": "https://opencode.ai/config.json",
"mcp": {
"ragscore": {
"type": "local",
"command": [
"uvx",
"ragscore==0.8.6"
],
"enabled": true,
"environment": {
"OPENAI_API_KEY": "{env:OPENAI_API_KEY}",
"ANTHROPIC_API_KEY": "{env:ANTHROPIC_API_KEY}"
}
}
}
}{
"mcpServers": {
"ragscore": {
"command": "uvx",
"args": [
"ragscore==0.8.6"
],
"env": {
"OPENAI_API_KEY": "${OPENAI_API_KEY}",
"ANTHROPIC_API_KEY": "${ANTHROPIC_API_KEY}"
}
}
},
"deeplink": "cursor://anysphere.cursor-deeplink/mcp/install?name=ragscore&config=eyJjb21tYW5kIjoidXZ4IiwiYXJncyI6WyJyYWdzY29yZT09MC44LjYiXSwiZW52Ijp7Ik9QRU5BSV9BUElfS0VZIjoiJHtPUEVOQUlfQVBJX0tFWX0iLCJBTlRIUk9QSUNfQVBJX0tFWSI6IiR7QU5USFJPUElDX0FQSV9LRVl9In19"
}{
"servers": {
"ragscore": {
"type": "stdio",
"command": "uvx",
"args": [
"ragscore==0.8.6"
],
"env": {
"OPENAI_API_KEY": "${OPENAI_API_KEY}",
"ANTHROPIC_API_KEY": "${ANTHROPIC_API_KEY}"
}
}
}
}{
"mcpServers": {
"ragscore": {
"command": "uvx",
"args": [
"ragscore==0.8.6"
],
"env": {
"OPENAI_API_KEY": "${OPENAI_API_KEY}",
"ANTHROPIC_API_KEY": "${ANTHROPIC_API_KEY}"
}
}
}
}extensions:
"ragscore":
enabled: true
name: "ragscore"
type: stdio
cmd: "uvx"
args:
- "ragscore==0.8.6"
envs:
"OPENAI_API_KEY": "${OPENAI_API_KEY}"
"ANTHROPIC_API_KEY": "${ANTHROPIC_API_KEY}"
timeout: 300
Placeholders to fill from your own secret store: ${OPENAI_API_KEY}, ${ANTHROPIC_API_KEY}. The registry never accepts secret values.
This is a local package: the command runs on your machine.
Not scored: fewer than three checks apply, usually because no remote answered a credential-free probe or the server is a local package.
protocol.modern, protocol.stateless, protocol.transport, protocol.list_ttlno remote answered a protocol handshake (not probed yet, unreachable, or local-only)auth.prm, auth.as_metadata, auth.cimdno remote uses OAuthauth.secret_in_urlno templated URLtools.descriptions, tools.description_length, tools.schemas, tools.annotations, tools.directory_hints, tools.token_cost, tools.api_dumptool list unknown (behind auth, not probed, or empty)stability.changes, stability.rug_pulltool list unknowndeps.known_vulns2 advisories of lower severity or without a published fix: GHSA-8mgp-746c-j5xp in [email protected] (direct, no fix yet), GHSA-4vvm-4w3v-6mr8 in [email protected] (direct, no fix yet)deps.mcp_sdk_versionthe official MCP SDK is not in the dependency graphdeps.resolvable[email protected] resolved: 34 packagesNo tool definition changes recorded. A server's first observation is its baseline; later probes record what changes.
Checks run on what our credential-free, read-only probes observe; tools are never called and no code audit is performed. How it is computed.
+repository +namespace-matches-repo ~liveness-unmeasured ~updated-154d-ago
Derived from observable signals (official registry feed and our own credential-free probes); no code audit performed. How it is computed.
[email protected] PyPI33 dependencies, resolved · advisories checked 2026-10-19
| advisory | severity | package | fixed in |
|---|---|---|---|
| GHSA-8mgp-746c-j5xpNLTK: Model-artifact APIs bypass pathsec and touch files outside allowed roots | high | [email protected]direct | no fix yet |
| GHSA-4vvm-4w3v-6mr8pypdf and PyPDF2 possible Infinite Loop when a comment isn't followed by a character | moderate | [email protected]direct | no fix yet |
Dependency graphs from deps.dev; advisories from OSV.dev, including the GitHub Advisory Database and the PyPI Advisory Database; all CC BY 4.0. The graph is what a clean install of this version resolves today; nothing was installed or run. How it is checked.
| package | registry | version | runtime | secrets |
|---|---|---|---|---|
ragscore | pypi | 0.8.6 | – | OPENAI_API_KEY, ANTHROPIC_API_KEY |
No tools observed. Local packages are never executed by the registry.
Schemas: list_tools.
{
"name": "io.github.HZYAI/ragscore",
"title": "RAGScore",
"$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
"version": "0.8.6",
"packages": [
{
"version": "0.8.6",
"transport": {
"type": "stdio"
},
"identifier": "ragscore",
"registryType": "pypi",
"environmentVariables": [
{
"name": "OPENAI_API_KEY",
"format": "string",
"isSecret": true,
"description": "OpenAI API key (if using OpenAI provider)"
},
{
"name": "ANTHROPIC_API_KEY",
"format": "string",
"isSecret": true,
"description": "Anthropic API key (if using Anthropic provider)"
}
]
}
],
"repository": {
"url": "https://github.com/HZYAI/RagScore",
"source": "github"
},
"description": "Generate QA datasets & evaluate RAG systems with failure diagnosis. Any LLM."
}