Repository navigation
Commit 929389f
authored
fix(installer): enable stock DGX OS on Station GB300 (#7108)
## Summary
- Enables the Station express recipe on physical Station GB300 systems
running stock DGX OS `7.2.0`, `7.4.0`, or `7.5.0`.
- Requires bounded `Station` and `GB300` DMI identifiers. Generic Ubuntu
preparation also requires the exact NVIDIA GB300 PCI identity
(`10de:31c2`) before any host mutation.
- Accepts only a bounded, root-owned, non-writable `/etc/dgx-release`
marker with a strict schema, well-formed OTA history,
`DGX_OTA_PRETTY_NAME="DGX OS"`, and `DGX_PLATFORM="DGX Server for
GALAXY-GB300"`.
- Validates the factory GB300 driver, zero volatile ECC errors, local
Docker/containerd/Buildx, `nvidia-ctk` CDI, and GPU visibility through
both CDI and `--gpus all` before continuing.
- Selects the local default Docker context before Station preparation
and does not replace stock host packages, restart services, generate CDI
configuration, or rewrite the Docker runtime.
- On Station GB300 only, grants direct-GPU sandboxes the exact read-only
BDF directory for each discovered NVIDIA display-class PCI device plus
only existing CPU, memory, NUMA, and NVIDIA module-initialization paths.
It does not grant `/sys`, the PCI parent subtree, or sysfs write access.
- Keeps bare `P3830`, partial product matches, unknown DGX OS releases,
NVIDIA BaseOS, unsafe markers, and other Station generations
fail-closed.
- Keeps DGX Station support status **Deferred** pending repeat
clean-host qualification and CI coverage.
## Why
Issue #7103 reports that the released express installer rejects the
stock DGX OS image shipped on Station. The prior qualification also
exposed the OpenShell sandbox CUDA failure tracked in
NVIDIA/OpenShell#2343. NemoClaw can safely address that runtime behavior
at its policy boundary while retaining released OpenShell `0.0.85`.
This does **not** claim that NVIDIA/OpenShell#2343 is fixed upstream,
promote Station support, or cover the dual-Station work in #7091.
Fixes #7103.
## Physical Station evidence
A clean-application-baseline run at `58c11e9d6` passed end to end on
physical DGX OS `7.5.0` Station GB300:
- zero containers, GPU processes, `8000`/`8080` listeners, installed
NemoClaw/OpenShell commands, and failed systemd units before
installation;
- exact installer source SHA verified after installation;
- released OpenShell `0.0.85` and local
`nvidia/nemotron-3-ultra-550b-a55b` serving;
- sandbox CUDA validation on GB300 with driver `595.71.05` and volatile
ECC `0/0`;
- Hermes one-shot and real TUI tool use with successful `write_file` and
`read_file` operations.
A separate physical A/B policy test established the least-privilege
sysfs boundary encoded at `2db0ea0bc`:
- no sysfs exception: sandbox CUDA initialization failed;
- exact GPU BDF plus existing CPU, memory, NUMA, and NVIDIA module-init
paths: sandbox CUDA initialization passed;
- `/sys/fs/cgroup/cgroup.controllers` and `/sys/class/net/lo/address`
remained denied;
- neither `/sys` nor `/sys/bus/pci/devices` is added to the generated
policy.
The exact `2db0ea0bc` full clean-install acceptance then passed in 910
seconds:
- resolved source SHA matched
`2db0ea0bcc3ecce1406ffea497465070d6ec4b7f`;
- the effective policy contained only GPU BDF `0009:06:00.0`, CPU,
memory, NUMA, and NVIDIA module-init sysfs paths, with no broad `/sys`
or PCI parent entry;
- sandbox CUDA, local Nemotron Ultra, and Hermes Agent health passed;
- Hermes used `write_file` and `read_file`, and the resulting two-line
artifact was independently verified;
- the exact GPU vendor path was readable while unrelated cgroup and
loopback-network sysfs reads remained denied.
After merging current `main`, the true review head is
`1874ac2ae9356d24fb6c2f8c340b8d9a8f31ae0a`. Its full
cold-application-baseline acceptance rerun is in progress; this body
will be updated with that result before re-review is requested.
## Verification
- merged Station/resume/policy regression set: **326 passed, 1 skipped**
across 13 files;
- focused installer and direct-GPU policy set: **191 passed, 1
skipped**;
- post-split Station identity/host-preparation set: **75 passed**;
- CLI and JS-config TypeScript checks: passed;
- ShellCheck, shell syntax, Biome, repository checks, docs
generation/sync, test-size budget, source-shape budget, test-conditional
scanner, and diff checks: passed;
- branch is based on current `main`.
Physical validation here is intentionally single-Station and does not
change the platform matrix from Deferred.
Signed-off-by: Aaron Erickson <[email protected]>
---------
Signed-off-by: Aaron Erickson <[email protected]>1 parent 43a0080 commit 929389f
20 files changed
Lines changed: 1639 additions & 158 deletions
File tree
- ci
- docs
- get-started
- inference
- reference
- scripts
- checks
- src/lib
- onboard
- machine
- state
- test
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | 3 | | |
4 | | - | |
| 4 | + | |
5 | 5 | | |
6 | 6 | | |
7 | 7 | | |
| |||
64 | 64 | | |
65 | 65 | | |
66 | 66 | | |
67 | | - | |
| 67 | + | |
68 | 68 | | |
69 | 69 | | |
70 | 70 | | |
| |||
147 | 147 | | |
148 | 148 | | |
149 | 149 | | |
150 | | - | |
| 150 | + | |
151 | 151 | | |
152 | 152 | | |
153 | 153 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
41 | 41 | | |
42 | 42 | | |
43 | 43 | | |
44 | | - | |
45 | | - | |
46 | | - | |
47 | | - | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
48 | 51 | | |
49 | 52 | | |
50 | 53 | | |
| |||
59 | 62 | | |
60 | 63 | | |
61 | 64 | | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
62 | 78 | | |
63 | 79 | | |
64 | | - | |
| 80 | + | |
65 | 81 | | |
66 | 82 | | |
67 | 83 | | |
| |||
0 commit comments