Infrastructure across environments
Configure GPU cloud backends, Kubernetes clusters, or SSH-accessible on-premises hosts, and manage compute through a common control plane.
dstack
Freemium
A control plane for provisioning and orchestrating GPU workloads across cloud, Kubernetes, and on-prem infrastructure.
什么是 dstack？
dstack is a unified control plane for provisioning and orchestrating GPU compute across GPU cloud providers, Kubernetes, and on-premises clusters. It coordinates infrastructure with AI development, training, and inference workflows, and supports NVIDIA, AMD, Google Cloud TPU, and Tenstorrent accelerators.
Users describe fleets and workloads in YAML configuration files stored with their project, then apply them through the dstack CLI or programmatic API. dstack handles infrastructure provisioning and job scheduling, with related capabilities including autoscaling, port forwarding, and ingress. The documented workload types include remote development environments, tasks for training or batch processing, and services that expose models or web applications as endpoints.
dstack 能做什么？
Declarative workload configurations
Define fleets, development environments, tasks, and services in YAML files, then apply them with the CLI or programmatic API.
Provisioning and scheduling
dstack provisions infrastructure and schedules submitted workloads. Fleets can be configured with node and GPU ranges, including templates that defer instance provisioning until runs are submitted.
Multi-node workloads
Tasks can run across clusters by specifying nodes or node groups; fleet placement can also be configured for cluster use.
Endpoints for services
Deploy models or web applications as services. Service replicas can be configured behind a single endpoint.
Multiple accelerator families
The documentation lists out-of-the-box support for NVIDIA, AMD, Google Cloud TPU, and Tenstorrent accelerators.
使用场景
“Develop remotely with an IDE”
Create a development environment on provisioned compute and connect using a desktop IDE such as VS Code or through SSH.
“Run training and batch jobs”
Submit command-based tasks for model training, batch processing, or other jobs, with configurations for single-node or multi-node execution.
“Serve a model or web application”
Package a service configuration with its command, port, model identifier where applicable, and resource requirements to deploy an endpoint.
“Manage a shared on-prem compute pool”
Register SSH-accessible servers as a fleet so workloads can use existing hosts that meet dstack's stated host requirements.
常见问题
What infrastructure can dstack manage?
The documentation describes GPU cloud providers, Kubernetes, and on-premises clusters. On-prem hosts can be configured through SSH fleets, subject to the documented host requirements.
How are workloads submitted?
Define a workload configuration, commonly as a YAML file, and apply it with the `dstack apply` CLI command. The documentation also describes a programmatic API.
What workload types are supported?
The documented configuration types include development environments, tasks, and services. Fleets define and manage pools of compute instances.
Can tasks use multiple nodes?
Yes. The quickstart says tasks can run on a cluster by specifying `nodes` or defining multiple node groups.
Does dstack include a hosted option?
The documentation says users can install the dstack server or sign up for dstack Sky.
快速信息
- Category
- GPU infrastructure orchestration
- Platform
- GPU clouds, Kubernetes, and on-premises clusters
- Accelerators
- NVIDIA, AMD, Google Cloud TPU, and Tenstorrent
- Workload configurations
- Fleets, development environments, tasks, services, and experimental inference presets
- Configuration workflow
- YAML files applied with the dstack CLI or programmatic API
- Official domain
- dstack.ai
dstack 流量分析
流量数据仅供参考。
- 域名评分
- 48
dstack 替代品
UbiOps
ubiops.com
Model serving and orchestration for AI teams deploying workloads across cloud and private infrastructure.
Cerebrium
cerebrium.ai
Serverless CPU and GPU infrastructure for teams deploying real-time AI workloads.
Nebius AI Cloud
nebius.com
Nebius AI Cloud 是一个专为开发、训练和部署 AI 工作负载打造的云平台，整合 GPU 与 CPU 计算、托管 Kubernetes、MLOps 工具，以及托管式或无服务器推理服务，助力团队从实验扩展到生产环境。
Huddle01 Cloud
huddle01.com
Huddle01 Cloud 面向开发者和应用团队，支持部署虚拟机、容器、Kubernetes 集群及 GPU 工作负载，并通过兼容 OpenAI 的接口调用多家供应商支持的模型。