dstackai/dstack repository overview

dstack is a streamlined alternative to Kubernetes, specifically designed for AI. It simplifies container orchestration for AI workloads both in the cloud and on-prem, speeding up the development, training, and deployment of AI models.

dstack supports NVIDIA GPU, AMD GPU, and Google Cloud TPU out of the box.

⁠Configure backends

To use dstack with your own cloud accounts, create the ~/.dstack/server/config.yml file and configure backends⁠.

⁠Start the server

Starting the dstack server via Docker can be done the following way:

docker run -p 3000:3000 -v $HOME/.dstack/server/:/root/.dstack/server dstackai/dstack

The dstack server is running at http://0.0.0.0:3000
The admin user token is 'bbae0f28-d3dd-4820-bf61-8f4bb40815da'

For more details on server configuration options, see the server deployment⁠ guide.

⁠Set up the CLI

To point the CLI to the dstack server, configure it with the server address, user token, and project name:

$ pip install dstack
$ dstack project add --name main \
    --url http://127.0.0.1:3000 \
    --token bbae0f28-d3dd-4820-bf61-8f4bb40815da
    
Configuration is updated at ~/.dstack/config.yml

⁠Create SSH fleets

If you want the dstack server to run containers on your on-prem servers, use fleets⁠.

⁠More information

For additional information and examples, see the following links:

• Docs⁠
• Examples⁠
• Changelog⁠
• Discord⁠

⁠License

Mozilla Public License 2.0⁠