protogrid

Search / io.github.theoddden/terradev

Terradev

R0· no sign-in

Cross-cloud GPU orchestration CLI.

v6.2.20 · active · repository · descriptor JSON · versions

An agent can connect right now, no human step.Remote endpoint, no authentication, reachable on the last probe.
Quality57needs work
Trust90of 100
Uptime, 30 days100%
Latency p50263 ms

Connect

8 clients · secrets stay placeholders
{
  "mcpServers": {
    "terradev": {
      "type": "sse",
      "url": "https://terradev-mcp.terradev.cloud/sse"
    }
  }
}
claude mcp add --transport sse terradev https://terradev-mcp.terradev.cloud/sse
[mcp_servers.terradev]
url = "https://terradev-mcp.terradev.cloud/sse"
{
  "$schema": "https://opencode.ai/config.json",
  "mcp": {
    "terradev": {
      "type": "remote",
      "url": "https://terradev-mcp.terradev.cloud/sse",
      "enabled": true
    }
  }
}
{
  "mcpServers": {
    "terradev": {
      "type": "sse",
      "url": "https://terradev-mcp.terradev.cloud/sse"
    }
  },
  "deeplink": "cursor://anysphere.cursor-deeplink/mcp/install?name=terradev&config=eyJ0eXBlIjoic3NlIiwidXJsIjoiaHR0cHM6Ly90ZXJyYWRldi1tY3AudGVycmFkZXYuY2xvdWQvc3NlIn0%3D"
}
{
  "servers": {
    "terradev": {
      "type": "sse",
      "url": "https://terradev-mcp.terradev.cloud/sse"
    }
  }
}
{
  "mcpServers": {
    "terradev": {
      "url": "https://terradev-mcp.terradev.cloud/sse"
    }
  }
}
extensions:
  "terradev":
    enabled: true
    name: "terradev"
    type: sse
    uri: "https://terradev-mcp.terradev.cloud/sse"
    timeout: 300

Quality 57 / 100needs work

protocol50 · weight 25
  • warn
    protocol.modernnewest supported version is 2025-11-25; 2026-07-28 not supported, older versions are deprecated until 2027-07-28
  • n/a
    protocol.statelessonly applies to 2026-07-28 servers
  • warn
    protocol.transportonly the legacy HTTP+SSE transport, deprecated until 2027-07-28
  • n/a
    protocol.list_ttlonly applies to 2026-07-28 servers
authorizationn/a · weight 15
  • n/a
    auth.prm, auth.as_metadata, auth.cimdno remote uses OAuth
  • n/a
    auth.secret_in_urlno templated URL
tool hygiene50 · weight 30
  • warn
    tools.descriptions3 of 277 tools have a description under 20 characters
  • pass
    tools.description_lengthdescriptions are concise
  • pass
    tools.schemasevery tool has an object input schema
  • fail
    tools.annotationsno tool declares readOnlyHint or destructiveHint, so clients cannot tell safe calls from risky ones
  • fail
    tools.directory_hintsno tool declares all four of readOnlyHint, destructiveHint, idempotentHint and openWorldHint; missing: up (readOnlyHint, destructiveHint, idempotentHint, openWorldHint); governance_record_consent (readOnlyHint, destructiveHint, idempotentHint, openWorldHint); infer_failover (readOnlyHint, destructiveHint, idempotentHint, openWorldHint); …
  • fail
    tools.token_costabout 38,007 tokens to load every tool, a large share of an agent's context
  • pass
    tools.api_dumptools are not a one-to-one API dump
stability75 · weight 15
  • warn
    stability.changes32 tool changes in 30 days
  • pass
    stability.rug_pullno tool changed its meaning under the same name
dependencies67 · weight 15
  • fail
    deps.known_vulns2 advisories to act on (malicious, or rated high or critical with a fix available): GHSA-2g87-pp6c-29x5 in [email protected] (direct, fixed in 3.14.4), GHSA-5wr8-gcqf-gqf3 in [email protected] (direct, fixed in 3.14.4); 1 more of lower severity or without a fix
  • pass
    deps.mcp_sdk_versionmcp 1.30.0, no known advisory
  • pass
    deps.resolvable[email protected] resolved: 66 packages

277 tools, about 38,007 tokens to load them all · tool set 9f07aeadf921 · tools last changed 2026-09-29 · checked 2026-10-20 04:09 UTC

Tool changes

  • triggers_historyadded

    Show trigger execution history.

  • triggers_executeadded

    Manually execute a trigger now.

  • triggers_enableadded

    Enable or disable a trigger.

  • triggers_listadded

    List configured triggers.

  • triggers_createadded

    Create an event trigger (schedule/webhook/metric).

  • quote_gpuadded

    Get a GPU price quote across providers.

  • preflight_provisionadded

    Run preflight validation before provisioning GPU instances.

  • migrate_compareadded

    Compare migration target providers by cost/compatibility.

  • migrate_rollbackadded

    Roll back a migration to the source provider.

  • migrate_statusadded

    Show status of running/completed migrations.

Showing the latest 10. Full history: list_changes · trend: quality JSON.

Checks run on what our credential-free, read-only probes observe; tools are never called and no code audit is performed. How it is computed.

Trust 90 / 100

provenance75
liveness100
freshness85
hygiene100

+repository +namespace-matches-repo -thin-description +reachable +uptime-100% ~updated-40d-ago

Derived from observable signals (official registry feed and our own credential-free probes); no code audit performed. How it is computed.

Dependencies

[email protected] PyPI65 dependencies, resolved · MCP SDK mcp 1.30.0 · advisories checked 2026-10-19

advisoryseveritypackagefixed in
GHSA-2g87-pp6c-29x5aiohttp: Multiple instances of excessive or unbounded memory/CPU usehigh[email protected]directfixed in 3.14.4
GHSA-5wr8-gcqf-gqf3aiohttp server lacks an initial request/header timeouthigh[email protected]directfixed in 3.14.4
GHSA-494j-54xm-rwp3AIOHTTP: Secure attribute not enforced for shared cookielow[email protected]directfixed in 3.14.4

Dependency graphs from deps.dev; advisories from OSV.dev, including the GitHub Advisory Database and the PyPI Advisory Database; all CC BY 4.0. The graph is what a clean install of this version resolves today; nothing was installed or run. How it is checked.

Endpoints

remoteauthreachableuptime 30dp50protocollast ok
https://terradev-mcp.terradev.cloud/sse ssenoneyes100%263 ms2025-11-252026-10-19
packageregistryversionruntimesecrets
terradev-clipypi6.2.20uvxRUNPOD_API_KEY, VAST_API_KEY, LAMBDA_API_KEY, HF_TOKEN, AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY, TERRADEV_MCP_BEARER_TOKEN

Tools (277)

active_contextGet current Terradev state: running training jobs, active instances, spend-to-date, alerts. Call this on session start to resume context from previous sessions.
agent_agentic_serving_configureConfigure agentic inference serving settings.
agent_agentic_serving_helm_valuesPrint Helm values for agentic inference deployment.
agent_agentic_serving_k8sPrint K8s deployment manifests for agentic inference.
agent_agentic_serving_launch_argsPrint engine launch arguments for copy-paste.
agent_agentic_serving_lmcache_envPrint LMCache environment variables.
agent_agentic_serving_show_configShow current agentic serving configuration.
agent_costShow real-time cost breakdown for a fleet by tier.
agent_deployProvision a heterogeneous agent fleet across all tiers simultaneously.
agent_langchain_create_langgraphCreate a LangGraph workflow.
agent_langchain_create_pipelineCreate an SGLang pipeline.
agent_langchain_create_workflowCreate a LangChain workflow.
agent_langchain_testTest connection to LangChain service.
agent_langgraph_create_workflowCreate a LangGraph workflow.
agent_langgraph_deployDeploy a workflow.
agent_langgraph_statusGet workflow status.
agent_langgraph_testTest connection to LangGraph service.
agent_letta_chatSend a message to a Letta agent.
agent_letta_createCreate a new stateful Letta agent.
agent_letta_deleteDelete a Letta agent.
agent_letta_listList Letta agents.
agent_letta_rememberTeach a Letta agent a durable fact.
agent_letta_statusShow the state of a Letta agent.
agent_listList all known agent fleets.
agent_mem0_addStore a memory in Mem0 for an agent or user.
agent_mem0_configureConfigure Mem0 credentials and defaults.
agent_mem0_deleteDelete a memory by ID.
agent_mem0_forgetDelete all memories matching an entity scope.
agent_mem0_getGet a single memory by ID.
agent_mem0_listList memories for an entity scope.
agent_mem0_searchSearch agent/user memories.
agent_mem0_testTest connection to Mem0.
agent_mem0_updateUpdate a memory by ID.
agent_planPlan a heterogeneous agent fleet without provisioning.
agent_scaleScale a single fleet tier up or down without affecting other tiers.
agent_skill_attachAttach a skill.md to a Letta agent as a durable memory block.
agent_skill_initCreate a skill.md template for an agent.
agent_statusShow live status of a fleet — tier health, KV hit rate, queue depth, cost.
agent_teardownTerminate all fleet instances and remove fleet state.
agent_vector_db_downTeardown a vector database provisioned for an agent fleet.
agent_vector_db_upProvision a vector database for an agent fleet.
analyticsGet cost analytics
checkpoint_deleteDelete a checkpoint.
checkpoint_listList all checkpoints for a training job.
checkpoint_promotePromote a checkpoint to a final model path for serving.
checkpoint_restoreRestore a specific checkpoint for a training job.
checkpoint_saveManually trigger a checkpoint save for a running training job.
configure_providerConfigure provider credentials
cost_analyzeDeep cost analysis of current GPU infrastructure: per-provider breakdown, utilization efficiency, waste identification, and optimization potential.
cost_optimize_recommendGenerate actionable cost optimization recommendations: spot migration, GPU right-sizing, provider arbitrage, idle shutdown, and density packing.
cost_simulateSimulate cost optimization scenarios with ROI projections. Compare current vs optimized infrastructure costs.
create_postgresql_connectionCreate a PostgreSQL database connection with auto-table creation. Returns a connection ID for subsequent operations.
create_sqlite_connectionCreate a SQLite database connection with auto-table creation. Returns a connection ID for subsequent operations.
database_weaviate_create_collectionCreate a Weaviate collection.
database_weaviate_delete_collectionDelete a Weaviate collection.
database_weaviate_hybrid_searchHybrid vector + BM25 search in a Weaviate collection.
database_weaviate_insertInsert objects into a Weaviate collection.
database_weaviate_list_collectionsList Weaviate collections.
database_weaviate_queryVector similarity search in a Weaviate collection.
database_weaviate_upInitialize a Weaviate connection.
deepeval_evaluateEvaluate a single LLM output with a DeepEval metric (AnswerRelevancy, Faithfulness, Hallucination, etc.).
deepeval_initGenerate a starter DeepEval test file.
deepeval_metricsList available DeepEval metrics for LLM evaluation.
deepeval_runRun a DeepEval test suite from a Python test file.
dvc_diffShow DVC diff between two revisions (e.g. training checkpoints). Shows added, modified, deleted files.
dvc_pushPush DVC-tracked data to the configured remote storage.
dvc_stage_checkpointAtomic checkpoint staging: DVC add + push + git commit in one operation. Promotes a training checkpoint to versioned storage.
dvc_statusGet DVC repository status: tracked files, remotes, and changes since last commit.
egress_cheapest_routeFind the cheapest egress route between cloud providers/regions for model weights or dataset transfer. Supports multi-hop routing.
egress_optimize_stagingOptimize dataset or model staging across regions by finding the cheapest transfer plan. Integrates with the dataset stager for parallel uploads.
environments_approveApprove a pending environment promotion.
environments_createCreate a named deployment environment (dev/staging/prod) with config.
environments_historyShow promotion/change history for an environment.
environments_listList deployment environments.
environments_promotePromote a workload or config between environments.
get_database_connectionGet information about a database connection including type, status, and configuration.
governance_compliance_reportGenerate comprehensive compliance report: consent stats, policy evaluations, data movements, violations. For GDPR/SOC2/HIPAA audits.
governance_evaluate_opaEvaluate OPA (Open Policy Agent) policies for data access. Checks region restrictions, classification rules, and compliance requirements.
governance_move_dataMove data with full governance audit trail. Requires prior consent and OPA policy approval. Tracks integrity, encryption, and compliance.
governance_movement_historyGet data movement audit log. Filter by user, dataset, or time range.
governance_record_consentRecord a consent response (granted or denied) for a pending consent request.
governance_request_consentRequest user consent for data movement across cloud regions. GDPR/SOC2 compliant consent tracking with audit trail.
gpu_topologyGPU NUMA topology report with intra-GPU XCD (Accelerated Compute Die) awareness. Models MI300X (8 XCDs, 192GB HBM3), MI300A (6 XCDs, 128GB), H200 (unified 141GB HBM3e), H100 (80GB). Reports PCIe locality (PIX/PXB/PHB/SYS), GPU-NIC pairing, SR-IOV VF status, and generates XCD-aware NCCL/AITER environment variables.
guardrails_chatSend a message through NeMo Guardrails and return the safety-filtered response. Applies topical, jailbreak, PII, and factcheck rails.
guardrails_generate_configGenerate default Colang 2.x guardrails configuration files (topical, jailbreak, PII, factcheck rails).
guardrails_k8sGenerate Kubernetes deployment manifest for NeMo Guardrails server (standalone or sidecar mode).
guardrails_testTest connection to NeMo Guardrails server.
helm_generateGenerate Helm charts from workload specifications.
hf_create_endpointCreate a HuggingFace Inference Endpoint (paid GPU endpoint). Supports custom GPU types, regions, and scaling.
hf_delete_endpointDelete a HuggingFace Inference Endpoint.
hf_endpoint_inferRun inference on a HuggingFace Inference Endpoint. Supports text generation, embeddings, and custom inputs.
hf_endpoint_infoGet detailed info about a specific HuggingFace Inference Endpoint: status, URL, scaling config, cost.
hf_hardware_compareCompare all hardware options for a HuggingFace model. Returns side-by-side cost, performance, and compatibility analysis.
hf_hardware_recommendGet hardware recommendation with cost breakdown for any HuggingFace model. Returns optimal GPU type, estimated cost, and performance score.
hf_list_datasetsSearch and browse HuggingFace Hub datasets. Filter by author and search query.
hf_list_endpointsList all active HuggingFace Inference Endpoints with status, URL, and cost.
hf_list_modelsSearch and browse HuggingFace Hub models. Filter by author, task, library. Returns model ID, downloads, likes, and tags.
hf_model_infoGet detailed model info: architecture, size, downloads, license, tags, pipeline_tag, and model card.
hf_smart_templateAuto-generate an optimized deployment template for any HuggingFace model. Analyzes model size, architecture, and quantization to select optimal hardware and generate ready-to-deploy configs.
hf_space_deployDeploy model to HuggingFace Spaces
hf_space_statusGet HuggingFace Space deployment status.
infer_failoverRun health checks and auto-failover for inference endpoints. If a primary endpoint is unhealthy and has a backup configured, traffic automatically shifts to the backup provider.
infer_routeSemantic-aware inference routing. Analyzes query content across 6 signal dimensions (modality, complexity, domain, language, safety, keywords), applies NUMA-aware endpoint scoring, and selects the optimal inference endpoint. Uses DAG parallel execution for signal extraction.
infer_route_disaggDisaggregated Prefill/Decode routing (DistServe architecture). Splits LLM inference into compute-bound prefill phase (routed to FLOPS-optimized GPUs like H100 SXM) and memory-bound decode phase (routed to bandwidth-optimized GPUs like MI300X). Tracks KV cache handoffs between endpoint pairs.
inferx_configureConfigure InferX serverless platform credentials.
inferx_deleteDelete an InferX model deployment.
inferx_deployDeploy model to InferX serverless platform
inferx_listList deployed InferX models
inferx_optimizeGet cost analysis for inference endpoints
inferx_quoteGet InferX pricing quotes for a GPU type.
inferx_statusCheck InferX endpoint status
inferx_usageGet InferX account usage statistics: requests, cost, GPU hours, latency.
k8s_createCreate Kubernetes cluster with GPU nodes for optimal multi-cloud deployment
k8s_destroyDestroy a Kubernetes cluster
k8s_device_pluginConfigure Kubernetes GPU device plugin settings: time-slicing, MIG strategy, and resource naming.
k8s_gpu_operator_installInstall NVIDIA GPU Operator on a Kubernetes cluster. Configures driver containers, device plugin, DCGM exporter, and GPU Feature Discovery.
k8s_infoGet information about a specific cluster
k8s_listList Kubernetes clusters
k8s_mig_configureConfigure Multi-Instance GPU (MIG) partitioning on A100/H100 GPUs. Splits a single GPU into isolated instances for multi-tenant workloads.
k8s_time_slicingConfigure GPU time-slicing for Kubernetes. Allows multiple pods to share a single GPU with configurable oversubscription.
karpenter_create_nodepoolCreate a Karpenter GPU NodePool.
karpenter_delete_nodepoolDelete a Karpenter NodePool.
karpenter_eventsShow recent Karpenter scaling events.
karpenter_gpu_nodesList GPU nodes provisioned by Karpenter.
karpenter_installInstall Karpenter on an EKS cluster for GPU node autoscaling.
karpenter_logsShow Karpenter controller logs.
karpenter_nodepoolsList Karpenter NodePools.
karpenter_resourcesShow Karpenter resource usage and capacity.
karpenter_statusShow Karpenter installation/controller status.
kserve_generate_yamlGenerate a GPU-aware KServe InferenceService YAML manifest with NUMA pinning, resource limits derived from model size and VRAM, and topology hints.
kserve_listList KServe InferenceServices in a Kubernetes namespace.
kserve_statusGet detailed status of a KServe InferenceService including readiness, traffic split, and URL.
kv_cache_efficiencyAnalyze KV cache efficiency across serving endpoints.
langchain_create_sglang_pipelineCreate an SGLang model-serving pipeline via LangChain. Connects LangChain agents to SGLang inference endpoints.
langchain_create_workflowCreate a LangChain workflow.
langfuse_configureConfigure Langfuse credentials (public key, secret key, host URL).
langfuse_datasetsList Langfuse datasets for evaluation and fine-tuning.
langfuse_export_training_dataExport Langfuse traces as instruction/response pairs for LoRA fine-tuning. Filters by quality score.
langfuse_k8sGenerate Kubernetes deployment manifest for self-hosted Langfuse.
langfuse_otel_envPrint OTEL environment variables for instrumenting LLM apps to send traces to Langfuse.
langfuse_qualityGet aggregated quality metrics from Langfuse scores for drift detection.
langfuse_scoreCreate an evaluation score for a Langfuse trace (e.g. quality, accuracy, relevance).
langfuse_scoresList evaluation scores from Langfuse, optionally filtered by trace or score name.
langfuse_testTest Langfuse connectivity and list accessible projects.
langfuse_traceGet a single Langfuse trace with all observations/spans.
langfuse_tracesList recent LLM traces from Langfuse.
langgraph_create_workflowCreate a LangGraph stateful workflow with monitoring. Supports agent graphs, tool calling, and state persistence.
langgraph_evaluation_workflowCreate an evaluator-optimizer workflow in LangGraph. Generates outputs, evaluates quality, and iteratively improves.
langgraph_orchestrator_workerCreate an orchestrator-worker pattern workflow in LangGraph. The orchestrator delegates tasks to specialized worker agents.
langgraph_workflow_statusGet the status and metrics of a LangGraph workflow execution.
lineage_checkpointRecord a data/model lineage checkpoint.
lineage_diffDiff lineage between two artifacts or checkpoints.
lineage_exportExport lineage data (JSON/graph) for an artifact.
lineage_graphRender the lineage graph for an artifact.
lineage_traceTrace the lineage of a dataset or model artifact.
local_scanScan local machine and network for available GPU devices. Returns total VRAM pool for local-first provisioning.
lora_addHot-load a LoRA adapter onto a running vLLM endpoint. The adapter becomes immediately available as a model name for inference requests. Uses vLLM's fused_moe_lora kernel for 454% higher output tokens/sec on MoE models.
lora_listList LoRA adapters loaded on a running vLLM endpoint. Shows base models and hot-loaded fine-tuned adapters.
lora_removeHot-unload a LoRA adapter from a running vLLM endpoint. Frees GPU memory for other adapters.
manage_instanceManage GPU instances (stop/start/terminate)
manifestsList cached manifests and versions for jobs.
migrate_compareCompare migration target providers by cost/compatibility.
migrate_executeExecute a previously-planned workload migration.
migrate_planPlan a workload migration between providers with cost analysis.
migrate_rollbackRoll back a migration to the source provider.
migrate_statusShow status of running/completed migrations.
mlflow_list_experimentsList MLflow experiments on the configured tracking server.
mlflow_log_runLog a Terradev training run to MLflow with auto-injected GPU type, provider, cost/hr, and duration as params.
mlflow_register_modelRegister a trained model in the MLflow model registry with Terradev provenance tags.
ml_vllm_lora_linkLoad the active registry version of an adapter onto a vLLM server.
ml_vllm_lora_listList LoRA adapters currently loaded on a vLLM server.
ml_vllm_lora_loadHot-load a LoRA adapter onto a running vLLM server.
ml_vllm_lora_syncSynchronize an adapter from the registry across multiple vLLM replicas.
ml_vllm_lora_unloadHot-unload a LoRA adapter from a running vLLM server.
moe_deployDeploy Mixture-of-Experts models with production-ready cluster templates. Auto-applies vLLM cost optimizations (KV cache offloading for up to 9x throughput, MTP speculative decoding for up to 2.8x speed, sleep mode for 18-200x faster restarts). Supports GLM-5, Qwen 3.5, Mistral Large 3, DeepSeek V4, Llama 5. Configures NVLink topology, tensor parallelism, FP8 quantization, vLLM/SGLang backends, and GPU-aware HPA autoscaling.
ollama_chatChat with an Ollama model using the chat/completions API.
ollama_generateGenerate text using an Ollama model (non-chat completions).
ollama_listList models available on an Ollama server.
ollama_model_infoGet detailed information about an Ollama model (parameters, template, license).
ollama_psList currently running Ollama models.
ollama_pullPull a model to an Ollama server on a remote instance.
optimizeFind cheaper alternatives for running instances
orchestrator_evictEvict a model from GPU memory.
orchestrator_inferTest inference with a model via the orchestrator.
orchestrator_loadLoad a model into GPU memory.
orchestrator_registerRegister a model with the orchestrator.
orchestrator_startStart the model orchestrator for multi-model GPU sharing with eviction policies.
orchestrator_statusGet orchestrator and model status including GPU memory utilization.
phoenix_k8sGenerate Kubernetes deployment manifest for self-hosted Arize Phoenix server.
phoenix_otel_envGenerate OpenTelemetry environment variables for instrumenting serving pods with Phoenix tracing.
phoenix_projectsList Phoenix projects (trace namespaces).
phoenix_snippetGenerate Python instrumentation snippet for adding Phoenix tracing to LLM applications.
phoenix_spansList recent spans for a Phoenix project. Supports SpanQuery DSL filters like "span_kind == 'RETRIEVER'" or "status_code == 'ERROR'".
phoenix_testTest connection to Arize Phoenix server. Returns collector endpoint and project count.
phoenix_traceView full execution tree for a specific trace ID. Shows span hierarchy, latencies, and token counts.
preflightPre-training validation: GPU availability, NCCL, RDMA, drivers across all nodes.
preflight_gpu_checkGPU-specific preflight validation: NVIDIA drivers, CUDA version, GPU count, NCCL, NVLink topology, NCU stall-signature profiling, and adversarial config verification (V1-V3).
preflight_network_checkNetwork-specific preflight validation: RDMA availability, InfiniBand status, inter-node bandwidth, latency matrix, firewall rules.
preflight_provisionRun preflight validation before provisioning GPU instances.
preflight_reportGenerate full preflight validation report with pass/warn/fail per check. Covers GPU drivers, CUDA, NCCL, RDMA, network, disk, and Docker.
price_intelGPU price intelligence with quantitative analytics. Computes delta (rate of change), gamma (acceleration), and annualized realized volatility on GPU spot/on-demand prices across 21+ providers. Identifies cheapest time windows and provider arbitrage opportunities.
price_spot_riskSpot instance risk assessment per provider. Returns interruption probability, mean time to interruption, and recommended mitigation.
price_trendsGet GPU price trend analysis with delta (rate of change), gamma (acceleration), and annualized volatility. Identifies cheapest time windows.
provision_gpuProvision GPU instances for optimal parallel efficiency
qdrant_collectionsList all Qdrant vector collections with their point counts and configurations.
qdrant_countCount points (vectors) in a Qdrant collection.
qdrant_create_collectionCreate a Qdrant vector collection. Auto-configures vector dimensions from embedding model name.
qdrant_infoGet detailed info and stats for a Qdrant collection.
qdrant_k8sGenerate Kubernetes StatefulSet manifest for self-hosted Qdrant vector database.
qdrant_testTest connection to Qdrant vector database. Returns cluster info and collection count.
query_databaseExecute a SELECT query on a database connection. Returns query results as a list of dictionaries.
quote_gpuGet a GPU price quote across providers.
ray_disagg_pd_deployGenerate a Ray Serve LLM disaggregated Prefill/Decode deployment. Splits inference into compute-bound prefill and memory-bound decode phases with KV cache transfer via NIXL.
ray_list_jobsList all running Ray jobs and tasks.
ray_parallelism_strategyCompute optimal TP/DP/EP parallelism strategy for a given MoE model and GPU count. Returns recommended configuration with rationale.
ray_startStart a Ray cluster (head node or worker). For distributed ML training and inference.
ray_statusGet Ray cluster status including node count, resources, memory, and running jobs.
ray_stopStop the Ray cluster on the current node.
ray_submit_jobSubmit a job script to the Ray cluster for distributed execution.
ray_wide_ep_deployGenerate a Ray Serve LLM Wide-EP (Expert Parallel) deployment for MoE models. Returns Python script and config for distributed MoE serving with EPLB and DeepEP.
rollbackExplicit versioned rollback. Format: job@version (e.g., llama3@v3).
run_workflowRun a declarative YAML workflow that chains multiple Terradev commands (provision → preflight → train → monitor → checkpoint). Returns step-by-step execution status with cost estimates and confirmation gates for expensive operations.
secrets_envPrint environment-style export lines for a provider. By default values are masked.
secrets_getRetrieve a stored secret. By default the value is masked.
secrets_listList stored provider and key names. Values are never shown.
secrets_removeRemove a provider or a single key from the secret store.
secrets_runRun a shell command with secrets injected into the environment.
secrets_setStore a secret in the Terradev secrets store. Values are encrypted at rest.
secrets_syncImport TERRADEV_* environment variables into the secret store for supported cloud providers.
secrets_verifyCheck which providers are fully configured and which keys are missing.
setup_providerGet setup instructions for a provider
sglangComplete SGLang optimization stack with workload-specific auto-tuning for 7 workload types: agentic chat, batch inference, low latency, MoE models, PD disaggregated, structured output, and RAG.
sglang_inference[DEPRECATED] Use sglang action='inference' instead. Test inference against a running SGLang endpoint.
sglang_start[DEPRECATED] Use sglang action='start' instead. Start an SGLang inference server on a remote instance.
sglang_stop[DEPRECATED] Use sglang action='stop' instead. Stop an SGLang server on a remote instance.
stageCompress, chunk, checksum, and position datasets near compute. Supports local paths, S3/GCS URIs, HTTP URLs, and HuggingFace dataset names. Returns staging plan with agent recommendations.
statusView all instances and costs with state optimization
trainLaunch distributed training on provisioned GPU nodes. Supports torchrun, deepspeed, accelerate, and megatron. Use from_provision='latest' to auto-resolve node IPs from your last provision command.
train_detect_stragglersDetect straggler nodes in distributed training. Identifies GPUs with significantly lower utilization that slow the whole job.
training_config_generateGenerate a complete training configuration from a declarative spec. Auto-detects framework, sets optimal parallelism, and configures distributed training.
training_launch_distributedFull distributed training launch with framework auto-detection, topology validation, and monitoring. Combines preflight + train + monitor in one operation.
train_monitorReal-time GPU monitoring for training jobs. Shows utilization, memory, temperature, power, and cost.
train_resumeResume a training job from its latest checkpoint. Rebuilds config with topology revalidation.
train_snapshotGet complete training monitoring snapshot: GPU metrics (utilization, memory, temp, power), training metrics (loss, grad_norm, lr, throughput), straggler detection, and cost estimate.
train_statusList all training jobs and their state (created, running, completed, failed).
train_stopStop a running training job. Kills training processes on all nodes in parallel.
train_unsloth_runRun an Unsloth local model server.
train_unsloth_startStart a coding agent backed by Unsloth's local model server.
train_unsloth_stopStop a running Unsloth server started with `unsloth run`.
triggers_createCreate an event trigger (schedule/webhook/metric).
triggers_enableEnable or disable a trigger.
triggers_executeManually execute a trigger now.
triggers_historyShow trigger execution history.
triggers_listList configured triggers.
upCLI-native provisioning with manifest cache and drift detection. Use --fix-drift to detect and auto-fix drifted infrastructure.
upsert_databaseInsert or update data in a database table. Performs upsert operation (insert or update on conflict).
vllm_analyzeAnalyze a running vLLM server's workload and return specific optimization recommendations with before/after comparisons.
vllm_auto_optimizeAutomatically optimize vLLM configuration by analyzing workload patterns. Selects optimal settings for the 6 critical knobs based on live endpoint metrics or sample request files.
vllm_benchmarkBenchmark a vLLM endpoint with concurrent requests. Returns throughput (req/s), success rate, and total latency.
vllm_inferenceTest inference against a running vLLM endpoint (completions or chat).
vllm_infoGet vLLM server info: loaded models, config, and health status.
vllm_sleepPut a vLLM server to sleep. Level 1: offload to CPU (fast wake). Level 2: discard weights (minimal RAM).
vllm_startStart a vLLM inference server on a remote instance via SSH/systemd. Supports Multi-LoRA, Sleep Mode, KV Offloading, Speculative Decoding.
vllm_stopStop a vLLM server on a remote instance.
vllm_wakeWake a sleeping vLLM server. For Level 2 sleep, also reloads weights and resets prefix cache.
wandb_create_dashboardCreate a custom W&B dashboard with GPU metrics, training loss, and cost panels.
wandb_create_reportCreate a W&B report with custom sections, charts, and narrative text.
wandb_create_terradev_alertsAuto-create standard Terradev alerts: GPU cost > budget, utilization < 50%, training loss spike, straggler detection.
wandb_create_terradev_dashboardAuto-create a Terradev-specific W&B dashboard with GPU utilization, cost tracking, training metrics, and infrastructure panels.
wandb_create_terradev_reportAuto-generate a Terradev infrastructure report: GPU costs, provider comparison, training efficiency, and recommendations.
wandb_dashboard_statusGet comprehensive W&B monitoring overview: dashboards, reports, alerts, active runs.
wandb_list_projectsList all Weights & Biases projects for the configured entity.
wandb_list_runsList runs in a W&B project with status, metrics summary, and config.
wandb_run_detailsGet detailed info, metrics, and artifacts for a specific W&B run.
wandb_setup_alertsSet up custom W&B alerts for GPU metrics: cost thresholds, utilization drops, training anomalies.
warm_pool_startStart the warm pool manager for intelligent model pre-warming. 5 strategies: traffic_based, time_based, priority_based, cost_optimized, latency_optimized.
warm_pool_statusGet warm pool status: hit rate, cold starts, memory saved, cost saved.

Schemas: list_tools.

Similar MCP servers

More from io.github.theoddden

Official server.json
{
  "name": "io.github.theoddden/terradev",
  "title": "Terradev",
  "$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
  "remotes": [
    {
      "url": "https://terradev-mcp.terradev.cloud/sse",
      "type": "sse"
    }
  ],
  "version": "6.2.20",
  "packages": [
    {
      "version": "6.2.20",
      "transport": {
        "type": "stdio"
      },
      "identifier": "terradev-cli",
      "runtimeHint": "uvx",
      "registryType": "pypi",
      "registryBaseUrl": "https://pypi.org",
      "packageArguments": [
        {
          "type": "positional",
          "value": "mcp"
        },
        {
          "type": "positional",
          "value": "serve"
        }
      ],
      "environmentVariables": [
        {
          "name": "RUNPOD_API_KEY",
          "isSecret": true,
          "description": "RunPod API key — get at runpod.io/console/settings/api-keys"
        },
        {
          "name": "VAST_API_KEY",
          "isSecret": true,
          "description": "Vast.ai API key — get at console.vast.ai/api-keys"
        },
        {
          "name": "LAMBDA_API_KEY",
          "isSecret": true,
          "description": "Lambda Labs API key — get at cloud.lambdalabs.com/api-keys"
        },
        {
          "name": "HF_TOKEN",
          "isSecret": true,
          "description": "HuggingFace API token — get at huggingface.co/settings/tokens"
        },
        {
          "name": "AWS_ACCESS_KEY_ID",
          "isSecret": true,
          "description": "AWS access key ID (pair with AWS_SECRET_ACCESS_KEY)"
        },
        {
          "name": "AWS_SECRET_ACCESS_KEY",
          "isSecret": true,
          "description": "AWS secret access key"
        },
        {
          "name": "GOOGLE_APPLICATION_CREDENTIALS",
          "description": "Path to GCP service account JSON key file"
        },
        {
          "name": "TERRADEV_MCP_BEARER_TOKEN",
          "isSecret": true,
          "description": "Bearer token for SSE/remote transport mode (stdio mode does not require this)"
        }
      ]
    }
  ],
  "repository": {
    "url": "https://github.com/theoddden/Terradev",
    "source": "github"
  },
  "description": "Cross-cloud GPU orchestration CLI."
}