-
Notifications
You must be signed in to change notification settings - Fork 207
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
Steps to reproduce
I am following the NVIDIA's official NIM tutorial ( LINK ), and I am using dstack Sky.
-
Generate API Key by following this step
-
Write a
nim.dstack.yml
type: service
image: nvcr.io/nim/meta/llama3-8b-instruct:latest
env:
- NGC_API_KEY
registry_auth:
username: "$oauthtoken"
password: $NGC_API_KEY
port: 8000
spot_policy: auto
resources:
gpu: 48GB
disk: 300GB..- Apply
nim.dstack.yml
$ dstack apply -f nim.dstack.ymlActual behaviour
Unexpected dstack server errorExpected behaviour
I should start provisioning
dstack version
0.18.17
Server logs
No response
Additional information
when specifying any commands under commands, the provisioning process starts.
However, it takes forever and outputs the following error eventually.
All provisioning attempts failed. This is likely due to cloud providers not having enough capacity. Check CLI and server logs for more details.Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working