Skip to content

feat(nvidia-setup): add bcm service that aliases kernel headers (AICR #1093)#48

Merged
ayuskauskas merged 3 commits into
mainfrom
feat/nvidia-setup-bcm-service
May 29, 2026
Merged

feat(nvidia-setup): add bcm service that aliases kernel headers (AICR #1093)#48
ayuskauskas merged 3 commits into
mainfrom
feat/nvidia-setup-bcm-service

Conversation

@ayuskauskas

Copy link
Copy Markdown
Collaborator

Summary

  • Adds a new bcm service to the nvidia-setup package that creates a full-directory symlink /usr/src/linux-$(uname -r) -> linux-headers-$(uname -r) so consumers (gpu-operator nvidia-driver-daemonset, NVIDIA DRA driver) which read /usr/src/linux-$(uname -r)/.config find it on Ubuntu. Replaces the manual pdsh hardlink workaround in AICR #1093 and survives reboot / kernel upgrade.
  • For service=bcm the apply stage skips the kernel/EFA pipeline entirely and runs only this single step; apply-check verifies the symlink resolves.
  • Cross-cutting across bcm-* accelerator combinations: ships bcm-h100 and bcm-gb200 defaults (intentionally empty — bcm uses no kernel/EFA/lustre versions).
  • Bumps nvidia-setup 0.2.20.3.0.

Closes NVIDIA/aicr#1093.

Test plan

  • Build the package image from this branch
  • Apply on a BCM/Ubuntu node with configMap: { service: bcm, accelerator: h100 } and confirm /usr/src/linux-$(uname -r)/.config resolves
  • Run aicr validate --phase deployment and --phase conformance end-to-end: nvidia-driver-daemonset clean, DRA pod reaches Running (no Init:0/1 stall), health checks green
  • Re-apply after a kernel upgrade and verify the alias is recreated for the new running kernel
  • Sanity: existing eks-h100 / eks-gb200 apply paths are unchanged

… #1093)

For service=bcm, the apply stage skips the kernel/EFA pipeline and runs a
single step: symlink /usr/src/linux-$(uname -r) -> linux-headers-$(uname -r)
so consumers reading /usr/src/linux-$(uname -r)/.config find it on Ubuntu.
Without this, aicr validate stalls (DRA pod Init:0/1, driver daemonset
unhealthy). Replaces the manual pdsh hardlink workaround and survives
reboot and kernel upgrades.

Bumps package version 0.2.2 -> 0.3.0.
… a real dir

A pre-existing real source tree at /usr/src/linux-$(uname -r) is not a
failure for the bcm service — the consumer's .config lookup will still
resolve. Log the situation and succeed instead of failing the step.
…RNING

Pairs with the previous commit: the step now succeeds in this case, so the
log prefix should match the exit code.
@ayuskauskas ayuskauskas merged commit d81a1d3 into main May 29, 2026
5 checks passed
@ayuskauskas ayuskauskas deleted the feat/nvidia-setup-bcm-service branch May 29, 2026 18:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

NodeWright: alias /usr/src/linux-$(uname -r)/.config to linux-headers tree on Ubuntu

1 participant