Search / io.github.psinglap/websearch-api-eval
Web Search API Eval
R0· no sign-inWeb search API benchmark for AI agents: You.com, Tavily, Exa, Parallel. Results and charts.
v1.1.0 · active · repository · website · descriptor JSON · versions
Search / io.github.psinglap/websearch-api-eval
R0· no sign-inWeb search API benchmark for AI agents: You.com, Tavily, Exa, Parallel. Results and charts.
v1.1.0 · active · repository · website · descriptor JSON · versions
{
"mcpServers": {
"websearch-api-eval": {
"type": "http",
"url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
}
}
}claude mcp add --transport http websearch-api-eval https://websearch-api-eval.psberkeleymba.workers.dev/mcp[mcp_servers.websearch-api-eval]
url = "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
{
"$schema": "https://opencode.ai/config.json",
"mcp": {
"websearch-api-eval": {
"type": "remote",
"url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp",
"enabled": true
}
}
}{
"mcpServers": {
"websearch-api-eval": {
"type": "http",
"url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
}
},
"deeplink": "cursor://anysphere.cursor-deeplink/mcp/install?name=websearch-api-eval&config=eyJ0eXBlIjoiaHR0cCIsInVybCI6Imh0dHBzOi8vd2Vic2VhcmNoLWFwaS1ldmFsLnBzYmVya2VsZXltYmEud29ya2Vycy5kZXYvbWNwIn0%3D"
}{
"servers": {
"websearch-api-eval": {
"type": "http",
"url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
}
}
}{
"mcpServers": {
"websearch-api-eval": {
"httpUrl": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
}
}
}extensions:
"websearch-api-eval":
enabled: true
name: "websearch-api-eval"
type: streamable_http
uri: "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
timeout: 300
protocol.modernnewest supported version is 2025-11-25; 2026-07-28 not supported, older versions are deprecated until 2027-07-28protocol.statelessonly applies to 2026-07-28 serversprotocol.transportstreamable HTTPprotocol.list_ttlonly applies to 2026-07-28 serversauth.prm, auth.as_metadata, auth.cimdno remote uses OAuthauth.secret_in_urlno templated URLtools.descriptionsevery tool has a descriptiontools.description_lengthdescriptions are concisetools.schemasevery tool has an object input schematools.annotations11 of 11 tools declare readOnlyHint or destructiveHinttools.directory_hintsevery tool declares readOnlyHint, destructiveHint, idempotentHint and openWorldHinttools.token_costabout 1,427 tokens to load every tooltools.api_dumptools are not a one-to-one API dumpstability.changesno tool changes in 30 daysstability.rug_pullno tool changed its meaning under the same nameNo tool definition changes recorded. A server's first observation is its baseline; later probes record what changes.
Checks run on what our credential-free, read-only probes observe; tools are never called and no code audit is performed. How it is computed.
+repository +namespace-matches-repo +website +reachable +uptime-100% +updated-11d-ago
Derived from observable signals (official registry feed and our own credential-free probes); no code audit performed. How it is computed.
[email protected] npmthis version is not known to the dependency resolver
Dependency graphs from deps.dev; advisories from OSV.dev, including the GitHub Advisory Database and the PyPI Advisory Database; all CC BY 4.0. The graph is what a clean install of this version resolves today; nothing was installed or run. How it is checked.
| remote | auth | reachable | uptime 30d | p50 | protocol | last ok |
|---|---|---|---|---|---|---|
https://websearch-api-eval.psberkeleymba.workers.dev/mcp streamable-http | none | yes | 100% | 232 ms | 2025-11-25 | 2026-11-07 |
| package | registry | version | runtime | secrets |
|---|---|---|---|---|
websearch-api-eval-mcp | npm | 1.1.0 | – | YDC_API_KEY, TAVILY_API_KEY, EXA_API_KEY, PARALLEL_API_KEY |
compare_providersread-only | Compare two or more of You.com, Tavily, Exa and Parallel side by side, overall or within one use case, optionally filtered to metrics whose name contains a keyword (e.g. 'latency', 'accuracy', 'fresh', 'cost', 'empty'). |
fetchread-only | Full text of one benchmark document by its ID (for example question-F5, scorecard-finance, overall, methodology). |
get_chartsread-only | The published graphs: overall scorecard, key metrics and per-query grids for GTM, insurance and finance, and developer activation. Without chart_id, lists them with titles and image links; with chart_id, also returns the image. |
get_methodologyread-only | How the benchmark was run and graded: query design, identical request parameters, 3 runs per query, latency timing, SimpleQA and FreshQA grading, the 10 metrics and the standards they follow, and limits. |
get_overall_resultsread-only | Headline findings and the overall scorecard across all 30 queries (90 calls per API): accuracy, fully correct, precision@5, freshness, empty responses, failed calls, latency p50/p95, cost per correct answer. Also the per-use-case summary, which API fits which agent, and developer activation time. |
get_questionread-only | One benchmark question by ID (e.g. G3, I4, F5): the task, search call, parameters, answer key with sources, and what each API returned with its accuracy score (0-2, mean of 3 runs). |
get_scorecardread-only | Full metric scorecard for one use case (gtm, insurance, finance) or 'overall'. Metrics: search-only latency p50/p95 (server and client), calls under 1 s, accuracy, freshness (% in window, newest relevant result age), content in one call, tokens, search cost. |
how_to_run_locallyread-only | How to rerun this benchmark on your own machine with your own API keys, including on your own queries. Nothing runs on this server. |
list_questionsread-only | The 30 benchmark questions (G1-G10 GTM, I1-I10 insurance, F1-F10 finance): ID, what the agent is asked, the search call and freshness. |
recommend_providerread-only | Which web search API fits an agent, based on this benchmark: live voice/chat turns, deep research, semantic or long-tail queries, docs lookups, or a specific use case (GTM, insurance, finance). Returns the guidance with the supporting numbers. |
searchread-only | Search the Web Search API Eval benchmark (results, questions, methodology, charts, how to run). Returns matching document IDs, titles and URLs. |
Schemas: list_tools.
{
"name": "io.github.psinglap/websearch-api-eval",
"title": "Web Search API Eval",
"$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
"remotes": [
{
"url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp",
"type": "streamable-http"
}
],
"version": "1.1.0",
"packages": [
{
"version": "1.1.0",
"transport": {
"type": "stdio"
},
"identifier": "websearch-api-eval-mcp",
"registryType": "npm",
"environmentVariables": [
{
"name": "YDC_API_KEY",
"isSecret": true,
"description": "Optional. You.com API key, used only by run_live_search"
},
{
"name": "TAVILY_API_KEY",
"isSecret": true,
"description": "Optional. Tavily API key, used only by run_live_search"
},
{
"name": "EXA_API_KEY",
"isSecret": true,
"description": "Optional. Exa API key, used only by run_live_search"
},
{
"name": "PARALLEL_API_KEY",
"isSecret": true,
"description": "Optional. Parallel API key, used only by run_live_search"
}
]
}
],
"repository": {
"url": "https://github.com/psinglap/websearch-api-eval",
"source": "github",
"subfolder": "mcp"
},
"websiteUrl": "https://psinglap.github.io/websearch-api-eval/",
"description": "Web search API benchmark for AI agents: You.com, Tavily, Exa, Parallel. Results and charts."
}