Search / io.github.agentwares/agentcheck
agentcheck
R0· no sign-inSynthetic checks, nightly regression replay and model-drift alerts for AI agents
v0.1.1 · active · repository · website · descriptor JSON · versions
Search / io.github.agentwares/agentcheck
R0· no sign-inSynthetic checks, nightly regression replay and model-drift alerts for AI agents
v0.1.1 · active · repository · website · descriptor JSON · versions
{
"mcpServers": {
"agentcheck": {
"type": "http",
"url": "https://agentwares-agentcheck.vercel.app/api/mcp",
"headers": {
"Authorization": "Bearer ${AGENTCHECK_TOKEN}"
}
}
}
}claude mcp add --transport http agentcheck https://agentwares-agentcheck.vercel.app/api/mcp --header "Authorization: Bearer ${AGENTCHECK_TOKEN}"[mcp_servers.agentcheck]
url = "https://agentwares-agentcheck.vercel.app/api/mcp"
bearer_token_env_var = "AGENTCHECK_TOKEN"
{
"$schema": "https://opencode.ai/config.json",
"mcp": {
"agentcheck": {
"type": "remote",
"url": "https://agentwares-agentcheck.vercel.app/api/mcp",
"enabled": true,
"headers": {
"Authorization": "Bearer {env:AGENTCHECK_TOKEN}"
}
}
}
}{
"mcpServers": {
"agentcheck": {
"type": "http",
"url": "https://agentwares-agentcheck.vercel.app/api/mcp",
"headers": {
"Authorization": "Bearer ${AGENTCHECK_TOKEN}"
}
}
},
"deeplink": "cursor://anysphere.cursor-deeplink/mcp/install?name=agentcheck&config=eyJ0eXBlIjoiaHR0cCIsInVybCI6Imh0dHBzOi8vYWdlbnR3YXJlcy1hZ2VudGNoZWNrLnZlcmNlbC5hcHAvYXBpL21jcCIsImhlYWRlcnMiOnsiQXV0aG9yaXphdGlvbiI6IkJlYXJlciAke0FHRU5UQ0hFQ0tfVE9LRU59In19"
}{
"servers": {
"agentcheck": {
"type": "http",
"url": "https://agentwares-agentcheck.vercel.app/api/mcp",
"headers": {
"Authorization": "Bearer ${AGENTCHECK_TOKEN}"
}
}
}
}{
"mcpServers": {
"agentcheck": {
"httpUrl": "https://agentwares-agentcheck.vercel.app/api/mcp",
"headers": {
"Authorization": "Bearer ${AGENTCHECK_TOKEN}"
}
}
}
}extensions:
"agentcheck":
enabled: true
name: "agentcheck"
type: streamable_http
uri: "https://agentwares-agentcheck.vercel.app/api/mcp"
headers:
"Authorization": "Bearer ${AGENTCHECK_TOKEN}"
timeout: 300
Placeholders to fill from your own secret store: ${AGENTCHECK_TOKEN}. The registry never accepts secret values.
protocol.modernsupports 2026-07-28 (server/discover)protocol.statelessanswers without a sessionprotocol.transportstreamable HTTPprotocol.list_ttltool list is cacheable (ttlMs 300000)auth.prm, auth.as_metadata, auth.cimdno remote uses OAuthauth.secret_in_urlno templated URLtools.descriptionsevery tool has a descriptiontools.description_length1 tools have descriptions over 1,024 characters, which crowds the contexttools.schemasevery tool has an object input schematools.annotations11 of 11 tools declare readOnlyHint or destructiveHinttools.directory_hintsevery tool declares readOnlyHint, destructiveHint, idempotentHint and openWorldHinttools.token_costabout 4,273 tokens to load every tooltools.api_dumptools are not a one-to-one API dumpstability.changes15 tool changes in 30 daysstability.rug_pullno tool changed its meaning under the same namedeps.known_vulns, deps.mcp_sdk_version, deps.resolvableno npm or PyPI packageagentcheck_api_sunsetschangeddescription, input schemaWhen does the API version this code pins stop working, and what happens then? Pass provider and version pairs as your code pins them (shopify 2025-10, meta v21.0, google-ads v22, hubspot v1, twilio-flex 2.16.2, keap xml-rpc, stripe 2024-06-20). For each, returns every dated end the provider's own versioning or changelog page lists: status, end date (and whether the provider gives only a month), what happens after it (error, silent fall-forward to another version, app delisting, or unsupported), whether the failure is silent, the replacement version, the source URL with the date it was read, and a page with the details. A pair with no entry comes back with the reason: older than every listed version, no end date published yet, or a provider that publishes none (Stripe). Covers Shopify, HubSpot, Meta Graph and Marketing APIs, Google Ads and Content API for Shopping, Twilio Flex UI and Thryv's Keap XML-RPC. No API key needed.
When does the API version this code pins stop working, and what happens then? Pass provider and version pairs as your code pins them (shopify 2025-10, meta v21.0, google-ads v22, hubspot v1, twilio-flex 2.16.2, twilio-notify v1, keap xml-rpc, exchange-online ews, stripe 2024-06-20). For each, returns every dated end the provider's own versioning, changelog or retirement page lists: status, end date (and whether the provider gives only a month), what happens after it (error, silent fall-forward to another version, app delisting, or unsupported), whether the failure is silent, the replacement version, the source URL with the date it was read, and a page with the details. Where the provider's own pages give different dates for the same end, other_dates lists each one with its page and date_note says which the counts run to. A pair with no entry comes back with the reason: older than every listed version, no end date published yet, or a provider that publishes none (Stripe). Covers Shopify, HubSpot, Meta Graph and Marketing APIs, Google Ads and Content API for Shopping, Twilio Flex UI and Notify, Thryv's Keap XML-RPC, and Exchange Web Services (EWS) in Exchange Online. No API key needed.
agentcheck_statuspage_previewaddedRead a public Atlassian Statuspage page once: its name, overall status, components (id, name, status, group) and unresolved incidents, from the page's own /api/v2/summary.json. Pass any address on the page: status.example.com, https://status.example.com/history or the JSON URL. Use it before POST /api/v1/statuspage, which turns the components you give a URL into a live agentcheck status page checked by agentcheck itself, with no signup; the answer carries that request's body. Same read as /statuspage/preview: only public addresses, 5-second timeout, 512 KB cap. Private pages cannot be read. No API key needed.
agentcheck_list_incidentschangedannotationsagentcheck_promote_tracechangedannotationsagentcheck_recordchangedannotationsagentcheck_run_nowchangedannotationsagentcheck_add_checkchangedannotationsagentcheck_create_targetchangedannotationsagentcheck_api_sunsetschangedannotationsagentcheck_model_retirementschangedannotationsShowing the latest 10. Full history: list_changes · trend: quality JSON.
Checks run on what our credential-free, read-only probes observe; tools are never called and no code audit is performed. How it is computed.
+repository +namespace-matches-repo +website +reachable +uptime-100% ~updated-42d-ago -duplicate-repo(7 names)
Derived from observable signals (official registry feed and our own credential-free probes); no code audit performed. How it is computed.
| remote | auth | reachable | uptime 30d | p50 | protocol | last ok |
|---|---|---|---|---|---|---|
https://agentwares-agentcheck.vercel.app/api/mcp streamable-http | none | yes | 100% | 256 ms | 2026-07-28, 2025-11-25, 2025-06-18, 2025-03-26, 2024-11-05, 2024-10-07 | 2026-10-19 |
agentcheck_add_check | Add a check to one of your targets. A check runs an input (http path/prompt, mcp tool call, a2a message) on a schedule and judges the answer with a golden: exact, contains, regex and json_schema cost nothing; rubric and baseline use the LLM judge (baseline = same outcome as the last known-good answer). Returns the check id. Requires an API key. |
agentcheck_api_sunsetsread-only | When does the API version this code pins stop working, and what happens then? Pass provider and version pairs as your code pins them (shopify 2025-10, meta v21.0, google-ads v22, hubspot v1, twilio-flex 2.16.2, twilio-notify v1, keap xml-rpc, exchange-online ews, stripe 2024-06-20). For each, returns every dated end the provider's own versioning, changelog or retirement page lists: status, end date (and whether the provider gives only a month), what happens after it (error, silent fall-forward to another version, app delisting, or unsupported), whether the failure is silent, the replacement version, the source URL with the date it was read, and a page with the details. Where the provider's own pages give different dates for the same end, other_dates lists each one with its page and date_note says which the counts run to. A pair with no entry comes back with the reason: older than every listed version, no end date published yet, or a provider that publishes none (Stripe). Covers Shopify, HubSpot, Meta Graph and Marketing APIs, Google Ads and Content API for Shopping, Twilio Flex UI and Notify, Thryv's Keap XML-RPC, and Exchange Web Services (EWS) in Exchange Online. No API key needed. |
agentcheck_create_targetdestructive | Enroll something to monitor: an http endpoint (JSON or OpenAI-style chat), a remote MCP server (Streamable HTTP url) or an A2A agent (origin with /.well-known/agent-card.json). Pass `checks` to create checks in the same call (POST /api/v1/probe proposes three). Returns the target id, the public status page, the badge SVG URL and a README snippet. The first check runs on the next scheduled tick, within five minutes; call agentcheck_run_now to run immediately. Free tier: 1 target, hourly; Starter+: 5-minute checks. Requires an API key. |
agentcheck_get_pricingread-only | Machine-readable pricing for agentcheck: tiers with monthly USD price, target limits, check interval and features, plus per-run add-ons. Same data as /pricing.json. No API key needed. |
agentcheck_get_statusread-only | Current status of a public monitored target: overall state, uptime over 24h/7d/30d, last check time, last nightly scores, open incidents and the badge/status URLs. Use the owner (GitHub login) and target slug from the status page URL https://agentwares-agentcheck.vercel.app/<owner>/<slug>. No API key needed. |
agentcheck_list_incidentsread-only | Open and recent incidents across your targets (or one target): when they opened/closed, the failing check and the cause. Requires an API key. |
agentcheck_model_retirementsread-only | Is this model retiring? Pass model IDs as your code or config names them (gpt-5-mini, claude-sonnet-4-5-20250929, gemini-2.5-flash, openai/o3-mini). For each, returns every announced shutdown on OpenAI's, Anthropic's and Google's own deprecation pages (OpenAI API, Claude API, Gemini API, Vertex AI): status, shutdown date, recommended replacement, the replacement's list-price ratio per token, the API changes the provider documents, the source URL with the date it was read, and a page with the details. retiring: false means no shutdown for that ID is on those pages. Language models only. No API key needed. |
agentcheck_promote_trace | Turn an imported or recorded trace into a replayable check whose golden is the recorded outcome (tool sequence + final-answer rubric). The check runs daily and in the nightly replay (Pro). Returns the check. Requires an API key. |
agentcheck_record | Record one production interaction with your agent (the prompt or messages, the final answer, the tools it called, optionally the model) as a trace on a target. Call it from your agent or from a proxy in front of it after each task; promote a good trace with agentcheck_promote_trace to replay it nightly and catch regressions. Requires an API key. |
agentcheck_run_now | Run every check of one of your targets immediately (outside the schedule) and return pass/fail per check with latency, judge cost and any incident opened or closed. Use it right after enrolling, or to confirm a fix. Requires an API key. |
agentcheck_statuspage_previewread-only | Read a public Atlassian Statuspage page once: its name, overall status, components (id, name, status, group) and unresolved incidents, from the page's own /api/v2/summary.json. Pass any address on the page: status.example.com, https://status.example.com/history or the JSON URL. Use it before POST /api/v1/statuspage, which turns the components you give a URL into a live agentcheck status page checked by agentcheck itself, with no signup; the answer carries that request's body. Same read as /statuspage/preview: only public addresses, 5-second timeout, 512 KB cap. Private pages cannot be read. No API key needed. |
Schemas: list_tools.
6 other active names share this repository: io.github.agentwares/agent-access-index, io.github.agentwares/agentguard-cloud, io.github.agentwares/deal-memo, io.github.agentwares/mcp-liveness, io.github.agentwares/readiness-scorer, io.github.agentwares/stablecoin-attestations
And 2 more from this publisher.
{
"name": "io.github.agentwares/agentcheck",
"title": "agentcheck",
"$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
"remotes": [
{
"url": "https://agentwares-agentcheck.vercel.app/api/mcp",
"type": "streamable-http",
"headers": [
{
"name": "Authorization",
"format": "string",
"isSecret": true,
"description": "Bearer ak_live_… — create one at /dashboard/keys. Omit it to use the free read-only tools (agentcheck_get_status, agentcheck_get_pricing)."
}
]
}
],
"version": "0.1.1",
"repository": {
"url": "https://github.com/agentwares/servers",
"source": "github",
"subfolder": "agentcheck"
},
"websiteUrl": "https://agentwares-agentcheck.vercel.app",
"description": "Synthetic checks, nightly regression replay and model-drift alerts for AI agents"
}