Skip to content

[Bug]: Unexpected dstack server error when commands are not specified #1828

@deep-diver

Description

@deep-diver

Steps to reproduce

I am following the NVIDIA's official NIM tutorial ( LINK ), and I am using dstack Sky.

  1. Generate API Key by following this step

  2. Write a nim.dstack.yml

type: service

image: nvcr.io/nim/meta/llama3-8b-instruct:latest
env:
  - NGC_API_KEY
registry_auth:
  username: "$oauthtoken"
  password: $NGC_API_KEY

port: 8000

spot_policy: auto
resources:
  gpu: 48GB
  disk: 300GB..
  1. Apply nim.dstack.yml
$ dstack apply -f nim.dstack.yml

Actual behaviour

Unexpected dstack server error

Expected behaviour

I should start provisioning

dstack version

0.18.17

Server logs

No response

Additional information

when specifying any commands under commands, the provisioning process starts.
However, it takes forever and outputs the following error eventually.

All provisioning attempts failed. This is likely due to cloud providers not having enough capacity. Check CLI and server logs for more details.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions