Search / io.github.mauricekleine/nonobench
Nonobench
R0· no sign-inAn open-source benchmark of how well LLMs solve nonogram puzzles, from 5x5 to 20x20.
v1.1.0 · active · repository · website · descriptor JSON · versions
Search / io.github.mauricekleine/nonobench
R0· no sign-inAn open-source benchmark of how well LLMs solve nonogram puzzles, from 5x5 to 20x20.
v1.1.0 · active · repository · website · descriptor JSON · versions
{
"mcpServers": {
"nonobench": {
"type": "http",
"url": "https://www.nonobench.com/mcp"
}
}
}claude mcp add --transport http nonobench https://www.nonobench.com/mcp[mcp_servers.nonobench]
url = "https://www.nonobench.com/mcp"
{
"$schema": "https://opencode.ai/config.json",
"mcp": {
"nonobench": {
"type": "remote",
"url": "https://www.nonobench.com/mcp",
"enabled": true
}
}
}{
"mcpServers": {
"nonobench": {
"type": "http",
"url": "https://www.nonobench.com/mcp"
}
},
"deeplink": "cursor://anysphere.cursor-deeplink/mcp/install?name=nonobench&config=eyJ0eXBlIjoiaHR0cCIsInVybCI6Imh0dHBzOi8vd3d3Lm5vbm9iZW5jaC5jb20vbWNwIn0%3D"
}{
"servers": {
"nonobench": {
"type": "http",
"url": "https://www.nonobench.com/mcp"
}
}
}{
"mcpServers": {
"nonobench": {
"httpUrl": "https://www.nonobench.com/mcp"
}
}
}extensions:
"nonobench":
enabled: true
name: "nonobench"
type: streamable_http
uri: "https://www.nonobench.com/mcp"
timeout: 300
protocol.modernsupports 2026-07-28 (server/discover)protocol.statelessanswers without a sessionprotocol.transportstreamable HTTPprotocol.list_ttltool list is cacheable (ttlMs 3600000)auth.prm, auth.as_metadata, auth.cimdno remote uses OAuthauth.secret_in_urlno templated URLtools.descriptionsevery tool has a descriptiontools.description_lengthdescriptions are concisetools.schemasevery tool has an object input schematools.annotations11 of 11 tools declare readOnlyHint or destructiveHinttools.directory_hintsno tool declares all four of readOnlyHint, destructiveHint, idempotentHint and openWorldHint; missing: list_families (destructiveHint, idempotentHint); compare_models (destructiveHint, idempotentHint); get_model_results (destructiveHint, idempotentHint); …tools.token_costabout 1,464 tokens to load every tooltools.api_dumptools are not a one-to-one API dumpstability.changes11 tool changes in 30 daysstability.rug_pullno tool changed its meaning under the same namedeps.known_vulns, deps.mcp_sdk_version, deps.resolvableno npm or PyPI packagelist_runschangedinput schema, output schema, annotationsget_model_puzzleschangedinput schema, output schema, annotationsget_puzzle_resultschangedinput schema, output schema, annotationscheck_solutionchangedoutput schema, annotationsget_puzzlechangedoutput schema, annotationslist_puzzleschangedoutput schema, annotationsget_model_resultschangedoutput schema, annotationscompare_modelschangedinput schema, output schema, annotationslist_familieschangedoutput schema, annotationslist_providerschangedoutput schema, annotationsShowing the latest 10. Full history: list_changes · trend: quality JSON.
Checks run on what our credential-free, read-only probes observe; tools are never called and no code audit is performed. How it is computed.
+repository +namespace-matches-repo +website +reachable +uptime-96% +updated-21d-ago
Derived from observable signals (official registry feed and our own credential-free probes); no code audit performed. How it is computed.
| remote | auth | reachable | uptime 30d | p50 | protocol | last ok |
|---|---|---|---|---|---|---|
https://www.nonobench.com/mcp streamable-http | none | yes | 96% | 451 ms | 2026-07-28 | 2026-10-20 |
check_solutionread-only | Check a grid against a puzzle's clues, using the same rule as the benchmark grader. Reports which rows and columns do not match. |
compare_modelsread-only | Side-by-side core overall and per-size accuracy, cost, latency and token results for model or family names. |
get_leaderboardread-only | Models ranked by accuracy; defaults to all effort levels for compatibility. |
get_model_puzzlesread-only | Which puzzles one model solved, missed, timed out on, or has not run. |
get_model_resultsread-only | Accuracy, cost, latency and token use for one model, broken down by grid size. |
get_puzzleread-only | One puzzle, including the clue text models were prompted with. The reference solution is only included on request; some puzzles have several valid solutions. |
get_puzzle_resultsread-only | Per-model outcomes for one puzzle. Answers are omitted unless requested. |
list_familiesread-only | Model families, available efforts and best variants. |
list_providersread-only | Provider ids, names, families and variant counts. |
list_puzzlesread-only | The benchmark puzzles with their ids and row/column clues. |
list_runsread-only | Individual benchmark runs (one model on one puzzle), optionally with the raw prompt and model output. |
Schemas: list_tools.
{
"name": "io.github.mauricekleine/nonobench",
"icons": [
{
"src": "https://www.nonobench.com/icon.svg",
"mimeType": "image/svg+xml"
}
],
"title": "Nonobench",
"$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
"remotes": [
{
"url": "https://www.nonobench.com/mcp",
"type": "streamable-http"
}
],
"version": "1.1.0",
"repository": {
"id": "1124680684",
"url": "https://github.com/mauricekleine/nonobench",
"source": "github"
},
"websiteUrl": "https://www.nonobench.com",
"description": "An open-source benchmark of how well LLMs solve nonogram puzzles, from 5x5 to 20x20."
}