protogrid

Search / io.github.psinglap/websearch-api-eval

Web Search API Eval

R0· no sign-in

Web search API benchmark for AI agents: You.com, Tavily, Exa, Parallel. Results and charts.

v1.1.0 · active · repository · website · descriptor JSON · versions

An agent can connect right now, no human step.Remote endpoint, no authentication, reachable on the last probe.
Quality91strong
Trust97of 100
Uptime, 30 days100%
Latency p50232 ms

Connect

8 clients · secrets stay placeholders
{
  "mcpServers": {
    "websearch-api-eval": {
      "type": "http",
      "url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
    }
  }
}
claude mcp add --transport http websearch-api-eval https://websearch-api-eval.psberkeleymba.workers.dev/mcp
[mcp_servers.websearch-api-eval]
url = "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
{
  "$schema": "https://opencode.ai/config.json",
  "mcp": {
    "websearch-api-eval": {
      "type": "remote",
      "url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp",
      "enabled": true
    }
  }
}
{
  "mcpServers": {
    "websearch-api-eval": {
      "type": "http",
      "url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
    }
  },
  "deeplink": "cursor://anysphere.cursor-deeplink/mcp/install?name=websearch-api-eval&config=eyJ0eXBlIjoiaHR0cCIsInVybCI6Imh0dHBzOi8vd2Vic2VhcmNoLWFwaS1ldmFsLnBzYmVya2VsZXltYmEud29ya2Vycy5kZXYvbWNwIn0%3D"
}
{
  "servers": {
    "websearch-api-eval": {
      "type": "http",
      "url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
    }
  }
}
{
  "mcpServers": {
    "websearch-api-eval": {
      "httpUrl": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
    }
  }
}
extensions:
  "websearch-api-eval":
    enabled: true
    name: "websearch-api-eval"
    type: streamable_http
    uri: "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
    timeout: 300

Quality 91 / 100strong

protocol75 · weight 25
  • warn
    protocol.modernnewest supported version is 2025-11-25; 2026-07-28 not supported, older versions are deprecated until 2027-07-28
  • n/a
    protocol.statelessonly applies to 2026-07-28 servers
  • pass
    protocol.transportstreamable HTTP
  • n/a
    protocol.list_ttlonly applies to 2026-07-28 servers
authorizationn/a · weight 15
  • n/a
    auth.prm, auth.as_metadata, auth.cimdno remote uses OAuth
  • n/a
    auth.secret_in_urlno templated URL
tool hygiene100 · weight 30
  • pass
    tools.descriptionsevery tool has a description
  • pass
    tools.description_lengthdescriptions are concise
  • pass
    tools.schemasevery tool has an object input schema
  • pass
    tools.annotations11 of 11 tools declare readOnlyHint or destructiveHint
  • pass
    tools.directory_hintsevery tool declares readOnlyHint, destructiveHint, idempotentHint and openWorldHint
  • pass
    tools.token_costabout 1,427 tokens to load every tool
  • pass
    tools.api_dumptools are not a one-to-one API dump
stability100 · weight 15
  • pass
    stability.changesno tool changes in 30 days
  • pass
    stability.rug_pullno tool changed its meaning under the same name
dependenciesn/a · weight 15
  • n/a
    deps.known_vulns, deps.mcp_sdk_version, deps.resolvabledeps.dev does not know [email protected]

11 tools, about 1,427 tokens to load them all · tool set 8aaf5d90328c · checked 2026-11-07 18:01 UTC

Tool changes

No tool definition changes recorded. A server's first observation is its baseline; later probes record what changes.

Checks run on what our credential-free, read-only probes observe; tools are never called and no code audit is performed. How it is computed.

Trust 97 / 100

provenance90
liveness100
freshness100
hygiene100

+repository +namespace-matches-repo +website +reachable +uptime-100% +updated-11d-ago

Derived from observable signals (official registry feed and our own credential-free probes); no code audit performed. How it is computed.

Dependencies

[email protected] npmthis version is not known to the dependency resolver

Dependency graphs from deps.dev; advisories from OSV.dev, including the GitHub Advisory Database and the PyPI Advisory Database; all CC BY 4.0. The graph is what a clean install of this version resolves today; nothing was installed or run. How it is checked.

Endpoints

remoteauthreachableuptime 30dp50protocollast ok
https://websearch-api-eval.psberkeleymba.workers.dev/mcp streamable-httpnoneyes100%232 ms2025-11-252026-11-07
packageregistryversionruntimesecrets
websearch-api-eval-mcpnpm1.1.0–YDC_API_KEY, TAVILY_API_KEY, EXA_API_KEY, PARALLEL_API_KEY

Tools (11)

compare_providersread-onlyCompare two or more of You.com, Tavily, Exa and Parallel side by side, overall or within one use case, optionally filtered to metrics whose name contains a keyword (e.g. 'latency', 'accuracy', 'fresh', 'cost', 'empty').
fetchread-onlyFull text of one benchmark document by its ID (for example question-F5, scorecard-finance, overall, methodology).
get_chartsread-onlyThe published graphs: overall scorecard, key metrics and per-query grids for GTM, insurance and finance, and developer activation. Without chart_id, lists them with titles and image links; with chart_id, also returns the image.
get_methodologyread-onlyHow the benchmark was run and graded: query design, identical request parameters, 3 runs per query, latency timing, SimpleQA and FreshQA grading, the 10 metrics and the standards they follow, and limits.
get_overall_resultsread-onlyHeadline findings and the overall scorecard across all 30 queries (90 calls per API): accuracy, fully correct, precision@5, freshness, empty responses, failed calls, latency p50/p95, cost per correct answer. Also the per-use-case summary, which API fits which agent, and developer activation time.
get_questionread-onlyOne benchmark question by ID (e.g. G3, I4, F5): the task, search call, parameters, answer key with sources, and what each API returned with its accuracy score (0-2, mean of 3 runs).
get_scorecardread-onlyFull metric scorecard for one use case (gtm, insurance, finance) or 'overall'. Metrics: search-only latency p50/p95 (server and client), calls under 1 s, accuracy, freshness (% in window, newest relevant result age), content in one call, tokens, search cost.
how_to_run_locallyread-onlyHow to rerun this benchmark on your own machine with your own API keys, including on your own queries. Nothing runs on this server.
list_questionsread-onlyThe 30 benchmark questions (G1-G10 GTM, I1-I10 insurance, F1-F10 finance): ID, what the agent is asked, the search call and freshness.
recommend_providerread-onlyWhich web search API fits an agent, based on this benchmark: live voice/chat turns, deep research, semantic or long-tail queries, docs lookups, or a specific use case (GTM, insurance, finance). Returns the guidance with the supporting numbers.
searchread-onlySearch the Web Search API Eval benchmark (results, questions, methodology, charts, how to run). Returns matching document IDs, titles and URLs.

Schemas: list_tools.

Similar MCP servers

Official server.json
{
  "name": "io.github.psinglap/websearch-api-eval",
  "title": "Web Search API Eval",
  "$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
  "remotes": [
    {
      "url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp",
      "type": "streamable-http"
    }
  ],
  "version": "1.1.0",
  "packages": [
    {
      "version": "1.1.0",
      "transport": {
        "type": "stdio"
      },
      "identifier": "websearch-api-eval-mcp",
      "registryType": "npm",
      "environmentVariables": [
        {
          "name": "YDC_API_KEY",
          "isSecret": true,
          "description": "Optional. You.com API key, used only by run_live_search"
        },
        {
          "name": "TAVILY_API_KEY",
          "isSecret": true,
          "description": "Optional. Tavily API key, used only by run_live_search"
        },
        {
          "name": "EXA_API_KEY",
          "isSecret": true,
          "description": "Optional. Exa API key, used only by run_live_search"
        },
        {
          "name": "PARALLEL_API_KEY",
          "isSecret": true,
          "description": "Optional. Parallel API key, used only by run_live_search"
        }
      ]
    }
  ],
  "repository": {
    "url": "https://github.com/psinglap/websearch-api-eval",
    "source": "github",
    "subfolder": "mcp"
  },
  "websiteUrl": "https://psinglap.github.io/websearch-api-eval/",
  "description": "Web search API benchmark for AI agents: You.com, Tavily, Exa, Parallel. Results and charts."
}