Search / io.github.manchittlab/thecrawler
TheCrawler
L0· runs locallyUniversal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.
v0.5.8 · active · repository · descriptor JSON · versions
Search / io.github.manchittlab/thecrawler
L0· runs locallyUniversal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.
v0.5.8 · active · repository · descriptor JSON · versions
{
"mcpServers": {
"thecrawler": {
"command": "npx",
"args": [
"-y",
"[email protected]"
]
}
}
}claude mcp add thecrawler -- npx -y [email protected][mcp_servers.thecrawler]
command = "npx"
args = ["-y", "[email protected]"]
{
"$schema": "https://opencode.ai/config.json",
"mcp": {
"thecrawler": {
"type": "local",
"command": [
"npx",
"-y",
"[email protected]"
],
"enabled": true
}
}
}{
"mcpServers": {
"thecrawler": {
"command": "npx",
"args": [
"-y",
"[email protected]"
]
}
},
"deeplink": "cursor://anysphere.cursor-deeplink/mcp/install?name=thecrawler&config=eyJjb21tYW5kIjoibnB4IiwiYXJncyI6WyIteSIsInRoZWNyYXdsZXJAMC41LjgiXX0%3D"
}{
"servers": {
"thecrawler": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"[email protected]"
]
}
}
}{
"mcpServers": {
"thecrawler": {
"command": "npx",
"args": [
"-y",
"[email protected]"
]
}
}
}extensions:
"thecrawler":
enabled: true
name: "thecrawler"
type: stdio
cmd: "npx"
args:
- "-y"
- "[email protected]"
timeout: 300
This is a local package: the command runs on your machine.
Not scored: fewer than three checks apply, usually because no remote answered a credential-free probe or the server is a local package.
protocol.modern, protocol.stateless, protocol.transport, protocol.list_ttlno remote answered a protocol handshake (not probed yet, unreachable, or local-only)auth.prm, auth.as_metadata, auth.cimdno remote uses OAuthauth.secret_in_urlno templated URLtools.descriptions, tools.description_length, tools.schemas, tools.annotations, tools.directory_hints, tools.token_cost, tools.api_dumptool list unknown (behind auth, not probed, or empty)stability.changes, stability.rug_pulltool list unknowndeps.known_vulns5 advisories of lower severity or without a published fix: GHSA-ch52-4w7c-c8xp in [email protected] (indirect, no fix yet), GHSA-hp3w-g68c-fv3c in [email protected] (indirect, no fix yet), GHSA-528h-pc64-c93x in [email protected] (indirect, fixed in 3.5.0), ...deps.mcp_sdk_version@modelcontextprotocol/sdk 1.30.1 has 1 known advisory (GHSA-6qxp-vccf-f47h); update @modelcontextprotocol/sdk to 1.31.0 or laterdeps.resolvable[email protected] resolved: 432 packagesNo tool definition changes recorded. A server's first observation is its baseline; later probes record what changes.
Checks run on what our credential-free, read-only probes observe; tools are never called and no code audit is performed. How it is computed.
+repository +namespace-matches-repo ~liveness-unmeasured ~updated-109d-ago
Derived from observable signals (official registry feed and our own credential-free probes); no code audit performed. How it is computed.
[email protected] npm431 dependencies, resolved · MCP SDK @modelcontextprotocol/sdk 1.30.1 · advisories checked 2026-10-19
| advisory | severity | package | fixed in |
|---|---|---|---|
| GHSA-6qxp-vccf-f47hMCP TypeScript SDK: OAuth client could send credentials to an authorization server chosen by the MCP server | high | @modelcontextprotocol/[email protected]MCP SDK, direct | fixed in 1.31.0 |
| GHSA-ch52-4w7c-c8xphttp-cache-semantics max-stale handling can disclose cross-user cached responses | high | [email protected]indirect | no fix yet |
| GHSA-528h-pc64-c93xstream-json: pick/ignore/filter/replace filters are O(depth²) on nested input — small crafted JSON blocks the event loop for seconds→minutes (DoS) | moderate | [email protected]indirect | fixed in 3.5.0 |
| GHSA-hqr4-qq8f-hg3xstream-json: JSONC parser and verifier re-scan the whole accumulated comment on every input chunk | moderate | [email protected]indirect | fixed in 3.6.0 |
| GHSA-mjw6-4jj6-33hcstream-json has a prototype pollution issue: Assembler writes this.current[this.key] on plain objects | moderate | [email protected]indirect | fixed in 3.6.0 |
| GHSA-hp3w-g68c-fv3csprintf-js vulnerable to denial of service through unbounded precision specifiers | moderate | [email protected]indirect | no fix yet |
Dependency graphs from deps.dev; advisories from OSV.dev, including the GitHub Advisory Database and the PyPI Advisory Database; all CC BY 4.0. The graph is what a clean install of this version resolves today; nothing was installed or run. How it is checked.
| package | registry | version | runtime | secrets |
|---|---|---|---|---|
thecrawler | npm | 0.5.8 | – |
No tools observed. Local packages are never executed by the registry.
Schemas: list_tools.
{
"name": "io.github.manchittlab/thecrawler",
"title": "TheCrawler",
"$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
"version": "0.5.8",
"packages": [
{
"version": "0.5.8",
"transport": {
"type": "stdio"
},
"identifier": "thecrawler",
"registryType": "npm"
}
],
"repository": {
"url": "https://github.com/manchittlab/TheCrawler",
"source": "github"
},
"description": "Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support."
}