BOOT LOOP ISSUE RESOLVED

This issue has now been resolved.

Users can now proceed with performing updates or setting up their Sparks. For details on the root cause please see below.

If your Spark was impacted (i.e. it is stuck in the update/boot sequence) please reflash your system using the following steps. The recovery media can be downloaded from the support page.

If your Spark is operating normally, you do not need to take any other action.

If you have not setup your Spark you can proceed with the normal setup, reflashing is not required.

We apologize for the inconvenience.


Yesterday, NVIDIA rolled out an update to improve download speeds and capacity for updates.

This inadvertently led to an incomplete update on some devices between 5:30AM and 7:30PM PST resulting in some devices getting stuck in the boot process.

While we did perform qualification and testing of this update, upon rollout we discovered a difference between our test and production environment. This resulted in a partial update that was released publicly.

We have adjusted our qualification and testing process to ensure this will not happen again.

3 Likes

This is absolutely hilarious, if only this was posted an hour and a half ago.

Little late for me, I’ll settle for a sticker when this is fixed.

1 Like

same :-(

Damn, just got an hour ago and updated just now. :(

didnt see this and i updated do i gotta reflash it?

Too late - I just received and updated as part of the initial setup. The device is up and running, but Nvidia drivers do not appear to be present. No GPU workflows work. What now?

To recover your system you will need to reflash your system using the following steps. Please do not attempt to reflash until after 7 PM PST.

Thank you for your patience.

i was able to load the recovery and it seems to have gotten it to work in recovery mode

My DGX is bricked too. What happened? 7PM PST is 10PM EST.
Just read the instructions… really want to understand what happened…Obviously whatever you did, was not tested.

How do you get the download media?

I found it here: DGX Spark for AI Developers - Get Started | NVIDIA Developer

1 Like

Set mine up around 3 pm central time using network appliance method, unresponsive, not booting, hard power off. Connected an Apple USB C Keyboard and Trackpad (both work fine), used grub to launch recovery mode, purged broken packages, booting fine on 6.11.0-1014-nvidia.

2 Likes

Does anyone having issue with this instruction? I’m unable to select “Restore Factory Keys” until I change the secure boot option to custom from ‘user’. And when I select “Restore Factory Key”, it prompts with “Rest without saving..”

Enable Secure Boot:

  • Use the Right Arrow key to select “Security”

  • Confirm that “Secure Boot” is set to “Enabled”

  • Select “Restore Factory Keys”

  • Use the arrow keys to select the “Save and Exit” BIOS screen, and select “Save Changes and Reset”

We are actively working on the fix and will continue to keep you updated. Thank you for your continued patience.

Had the same issue, just change it to “custom” and follow the other instructions.

Can you please provide an updated ETC? Missing a deadline is understandable, but not providing guidance on a timeline to resolution is a very bad practice.

Next update will be available at 8:30 PM PST

1 Like

I just set up my DGX Spark and can confirm that the updates went through and I can now log in and use my machine.

2 Likes

We are actively testing the fix. Next update at ~11 PM PST

1 Like