Infrastructure across environments
Configure GPU cloud backends, Kubernetes clusters, or SSH-accessible on-premises hosts, and manage compute through a common control plane.
A control plane for provisioning and orchestrating GPU workloads across cloud, Kubernetes, and on-prem infrastructure.
dstack is a unified control plane for provisioning and orchestrating GPU compute across GPU cloud providers, Kubernetes, and on-premises clusters. It coordinates infrastructure with AI development, training, and inference workflows, and supports NVIDIA, AMD, Google Cloud TPU, and Tenstorrent accelerators.
Users describe fleets and workloads in YAML configuration files stored with their project, then apply them through the dstack CLI or programmatic API. dstack handles infrastructure provisioning and job scheduling, with related capabilities including autoscaling, port forwarding, and ingress. The documented workload types include remote development environments, tasks for training or batch processing, and services that expose models or web applications as endpoints.
Configure GPU cloud backends, Kubernetes clusters, or SSH-accessible on-premises hosts, and manage compute through a common control plane.
Define fleets, development environments, tasks, and services in YAML files, then apply them with the CLI or programmatic API.
dstack provisions infrastructure and schedules submitted workloads. Fleets can be configured with node and GPU ranges, including templates that defer instance provisioning until runs are submitted.
Tasks can run across clusters by specifying nodes or node groups; fleet placement can also be configured for cluster use.
Deploy models or web applications as services. Service replicas can be configured behind a single endpoint.
The documentation lists out-of-the-box support for NVIDIA, AMD, Google Cloud TPU, and Tenstorrent accelerators.
Create a development environment on provisioned compute and connect using a desktop IDE such as VS Code or through SSH.
Submit command-based tasks for model training, batch processing, or other jobs, with configurations for single-node or multi-node execution.
Package a service configuration with its command, port, model identifier where applicable, and resource requirements to deploy an endpoint.
Register SSH-accessible servers as a fleet so workloads can use existing hosts that meet dstack's stated host requirements.
The documentation describes GPU cloud providers, Kubernetes, and on-premises clusters. On-prem hosts can be configured through SSH fleets, subject to the documented host requirements.
Define a workload configuration, commonly as a YAML file, and apply it with the `dstack apply` CLI command. The documentation also describes a programmatic API.
The documented configuration types include development environments, tasks, and services. Fleets define and manage pools of compute instances.
Yes. The quickstart says tasks can run on a cluster by specifying `nodes` or defining multiple node groups.
The documentation says users can install the dstack server or sign up for dstack Sky.
トラフィックデータは参考情報としてご利用ください。
ubiops.com
Model serving and orchestration for AI teams deploying workloads across cloud and private infrastructure.
runpod.io
Cloud GPU infrastructure for AI development, training, inference, and batch workloads.
nebius.com
Nebius AI Cloud is a purpose-built cloud platform for developing, training, and serving AI workloads. It combines GPU and CPU compute, managed Kubernetes, MLOps tooling, and managed or serverless inference for teams scaling from experiments to production.
sambanova.ai
SambaNova is an AI inference platform for developers, enterprises, and infrastructure operators running large open-source models and agentic workloads. It combines cloud services with deployable hardware and software for cloud, on-premises, hybrid, and air-gapped environments.
hyperbolic.xyz
Hyperbolic is an open-access GPU and AI cloud for deploying on-demand H100, H200, B200, and other GPU capacity. It supports experimentation, training, fine-tuning, inference, and production workloads through on-demand instances, reserved clusters, and Private Cloud infrastructure.
inference.net
Inference.net is infrastructure for running, monitoring, evaluating, training, and deploying production AI workloads. It helps AI-native teams observe model behavior, route traffic across providers, and improve cost, latency, reliability, and quality through connected workflows.