Connect

8 clients · secrets stay placeholders

JSON (mcpServers)Claude CodeCodexOpenCodeCursorVS CodeGemini CLIGoose

{
  "mcpServers": {
    "openmark": {
      "type": "http",
      "url": "https://openmark.ai/mcp",
      "headers": {
        "Authorization": "Bearer ${OPENMARK_TOKEN}"
      }
    }
  }
}

claude mcp add --transport http openmark https://openmark.ai/mcp --header "Authorization: Bearer ${OPENMARK_TOKEN}"

[mcp_servers.openmark]
url = "https://openmark.ai/mcp"
bearer_token_env_var = "OPENMARK_TOKEN"

{
  "$schema": "https://opencode.ai/config.json",
  "mcp": {
    "openmark": {
      "type": "remote",
      "url": "https://openmark.ai/mcp",
      "enabled": true,
      "headers": {
        "Authorization": "Bearer {env:OPENMARK_TOKEN}"
      }
    }
  }
}

{
  "mcpServers": {
    "openmark": {
      "type": "http",
      "url": "https://openmark.ai/mcp",
      "headers": {
        "Authorization": "Bearer ${OPENMARK_TOKEN}"
      }
    }
  },
  "deeplink": "cursor://anysphere.cursor-deeplink/mcp/install?name=openmark&config=eyJ0eXBlIjoiaHR0cCIsInVybCI6Imh0dHBzOi8vb3Blbm1hcmsuYWkvbWNwIiwiaGVhZGVycyI6eyJBdXRob3JpemF0aW9uIjoiQmVhcmVyICR7T1BFTk1BUktfVE9LRU59In19"
}

{
  "servers": {
    "openmark": {
      "type": "http",
      "url": "https://openmark.ai/mcp",
      "headers": {
        "Authorization": "Bearer ${OPENMARK_TOKEN}"
      }
    }
  }
}

{
  "mcpServers": {
    "openmark": {
      "httpUrl": "https://openmark.ai/mcp",
      "headers": {
        "Authorization": "Bearer ${OPENMARK_TOKEN}"
      }
    }
  }
}

extensions:
  "openmark":
    enabled: true
    name: "openmark"
    type: streamable_http
    uri: "https://openmark.ai/mcp"
    headers:
      "Authorization": "Bearer ${OPENMARK_TOKEN}"
    timeout: 300

Placeholders to fill from your own secret store: ${OPENMARK_TOKEN}. The registry never accepts secret values.

Quality 73 / 100new

protocol75 · weight 25

warn
protocol.modernnewest supported version is 2025-06-18; 2026-07-28 not supported, older versions are deprecated until 2027-07-28
n/a
protocol.statelessonly applies to 2026-07-28 servers
pass
protocol.transportstreamable HTTP
n/a
protocol.list_ttlonly applies to 2026-07-28 servers

authorizationn/a · weight 15

n/a
auth.prm, auth.as_metadata, auth.cimdno remote uses OAuth
n/a
auth.secret_in_urlno templated URL

tool hygiene71 · weight 30

pass
tools.descriptionsevery tool has a description
pass
tools.description_lengthdescriptions are concise
pass
tools.schemasevery tool has an object input schema
fail
tools.annotationsno tool declares readOnlyHint or destructiveHint, so clients cannot tell safe calls from risky ones
fail
tools.directory_hintsno tool declares all four of readOnlyHint, destructiveHint, idempotentHint and openWorldHint; missing: get_task_format (readOnlyHint, destructiveHint, idempotentHint, openWorldHint); list_models (readOnlyHint, destructiveHint, idempotentHint, openWorldHint); prepare_attachments (readOnlyHint, destructiveHint, idempotentHint, openWorldHint); …
pass
tools.token_costabout 763 tokens to load every tool
pass
tools.api_dumptools are not a one-to-one API dump

stabilityn/a · weight 15

n/a
stability.changes, stability.rug_pulltool history recorded for 0 of the 7 days needed

dependenciesn/a · weight 15

n/a
deps.known_vulns, deps.mcp_sdk_version, deps.resolvableno npm or PyPI package

7 tools, about 763 tokens to load them all · tool set dc610f0cb232 · checked 2026-10-19 10:52 UTC

Tool changes

No tool definition changes recorded. A server's first observation is its baseline; later probes record what changes.

Checks run on what our credential-free, read-only probes observe; tools are never called and no code audit is performed. How it is computed.

Trust 56 / 100

no-repository

provenance55

liveness10

freshness100

hygiene80

+dns-namespace +website -unreachable(1 failures) +updated-1d-ago -no-repository

Derived from observable signals (official registry feed and our own credential-free probes); no code audit performed. How it is computed.

Endpoints

remote	auth	reachable	uptime 30d	p50	protocol	last ok
`https://openmark.ai/mcp` streamable-http	api_key `${OPENMARK_TOKEN}`	no (1 failures)	50%	306 ms	2025-06-18	2026-10-18

Tools (7)

`get_account`	The user's plan, credit balance and limits, and what a credit pack, Pro or Expert would unlock. Use it before large runs, or when a run is refused for credits or limits.
`get_results`	Status of a benchmark job, and once completed the ranked results (score, stability, cost per run, latency) plus a recommendation for the chosen objective and quick picks for the others.
`get_task_format`	How to write an OpenMark task: the YAML structure, every scoring mode, and tips. Call this before writing a task.
`list_models`	Current OpenMark model ids with list prices ($ per 1M tokens). Use these ids in run_benchmark. Append @low, @medium or @high to a reasoning model id to set its reasoning effort.
`prepare_attachments`	Get an upload_uid and the exact command to upload images, PDFs or text documents for a task. Upload the files, reference them by file name in each test's attachments list, then pass the upload_uid to run_benchmark.
`run_benchmark`	Save a task (YAML, see get_task_format) to the user's OpenMark account and run it on the given models with real API calls. Returns a job_id; poll get_results. Spends the user's credits.
`watch_task`	Watch the task of a completed job: OpenMark re-tests it on new or cheaper models as they ship (no credits used) and emails the user only when one beats the best model of that job.

Schemas: list_tools.

Similar MCP servers

Official server.json

{
  "name": "ai.openmark/openmark",
  "title": "OpenMark",
  "$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
  "remotes": [
    {
      "url": "https://openmark.ai/mcp",
      "type": "streamable-http",
      "headers": [
        {
          "name": "Authorization",
          "isSecret": true,
          "isRequired": true,
          "description": "Bearer followed by your personal key (om_...) from openmark.ai/ui, account menu > API keys"
        }
      ]
    }
  ],
  "version": "1.0.0",
  "websiteUrl": "https://openmark.ai/mcp",
  "description": "Benchmark your own prompt on 100+ LLMs with real API calls; pick the cheapest model that passes."
}