Skip to content
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
f92ee6c
Initial plan
Copilot Nov 16, 2025
5e08b07
Move install_gpu_driver.ps1 to ci/tools and update call sites
Copilot Nov 16, 2025
2219f3b
Update install_gpu_driver.ps1 to support GPU type detection and drive…
Copilot Nov 16, 2025
de5b109
Make nightly sections empty in ci/test-matrix.json
Copilot Nov 16, 2025
585e184
Expand Windows test matrix with driver mode support
Copilot Nov 16, 2025
de42011
Wire driver mode from test-matrix.json into Windows workflow
Copilot Nov 16, 2025
35fa159
Update install_gpu_driver.ps1 to match CCCL implementation with drive…
Copilot Nov 16, 2025
da32f6c
Simplify driver mode handling per review feedback
Copilot Nov 16, 2025
a4a65ad
Use GPU_TYPE env var instead of parsing JOB_RUNNER
Copilot Nov 16, 2025
16b0e3f
ensure each GPU kind are tested under two modes
leofang Nov 16, 2025
f789922
fix arch coverage
leofang Nov 16, 2025
f2ffbb1
make script more flexible; ensure cover 6 different GPUs, each with 2…
leofang Nov 16, 2025
0293947
Add driver mode verification and change v100 to rtxpro6000 for CUDA 13
Copilot Nov 17, 2025
1706a06
fix
leofang Nov 17, 2025
2393b68
merge
leofang Nov 17, 2025
e363f0e
ensure using CTK 12.x with V100 + driver mode check can fail
leofang Nov 17, 2025
3370245
fix syntax
leofang Nov 17, 2025
c7abbdf
avoid testing Quadro + WDDM; make driver mode show up in pipeline names
leofang Nov 17, 2025
7dc0f91
add missing `test-cu12-ft` dep group
leofang Nov 17, 2025
85c0059
fix VMM on Windows
leofang Nov 18, 2025
f716719
Merge branch 'fix_vmm' into copilot/move-install-gpu-driver-script
leofang Nov 18, 2025
ca1aa74
[pre-commit.ci] auto code formatting
pre-commit-ci[bot] Nov 18, 2025
3781575
RTX cards cannot run MCDM, switch back to L4 for now
leofang Nov 18, 2025
da63359
fix silly typo
leofang Nov 18, 2025
6c8cbcb
fix stupid negation
leofang Nov 18, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
make script more flexible; ensure cover 6 different GPUs, each with 2…
… different modes

rtx2080, rtx4090, rtxpro6000, v100, a100, l4 (t4 nodes are too slow)
  • Loading branch information
leofang committed Nov 16, 2025
commit f2ffbb18d56a0c84c1879baafb458d281c79b9ce
12 changes: 6 additions & 6 deletions ci/test-matrix.json
Original file line number Diff line number Diff line change
Expand Up @@ -39,13 +39,13 @@
{ "ARCH": "amd64", "PY_VER": "3.11", "CUDA_VER": "12.9.1", "LOCAL_CTK": "1", "GPU": "a100", "DRIVER": "latest", "DRIVER_MODE": "MCDM" },
{ "ARCH": "amd64", "PY_VER": "3.11", "CUDA_VER": "13.0.2", "LOCAL_CTK": "0", "GPU": "rtx4090", "DRIVER": "latest", "DRIVER_MODE": "WDDM" },
{ "ARCH": "amd64", "PY_VER": "3.12", "CUDA_VER": "12.9.1", "LOCAL_CTK": "0", "GPU": "l4", "DRIVER": "latest", "DRIVER_MODE": "MCDM" },
{ "ARCH": "amd64", "PY_VER": "3.12", "CUDA_VER": "13.0.2", "LOCAL_CTK": "1", "GPU": "a100", "DRIVER": "latest", "DRIVER_MODE": "TCC" },
{ "ARCH": "amd64", "PY_VER": "3.13", "CUDA_VER": "12.9.1", "LOCAL_CTK": "1", "GPU": "rtxpro6000", "DRIVER": "latest", "DRIVER_MODE": "TCC" },
{ "ARCH": "amd64", "PY_VER": "3.13", "CUDA_VER": "13.0.2", "LOCAL_CTK": "0", "GPU": "l4", "DRIVER": "latest", "DRIVER_MODE": "TCC" },
{ "ARCH": "amd64", "PY_VER": "3.14", "CUDA_VER": "12.9.1", "LOCAL_CTK": "0", "GPU": "a100", "DRIVER": "latest", "DRIVER_MODE": "MCDM" },
{ "ARCH": "amd64", "PY_VER": "3.12", "CUDA_VER": "13.0.2", "LOCAL_CTK": "1", "GPU": "v100", "DRIVER": "latest", "DRIVER_MODE": "TCC" },
{ "ARCH": "amd64", "PY_VER": "3.13", "CUDA_VER": "12.9.1", "LOCAL_CTK": "1", "GPU": "rtx2080", "DRIVER": "latest", "DRIVER_MODE": "MCDM" },
{ "ARCH": "amd64", "PY_VER": "3.13", "CUDA_VER": "13.0.2", "LOCAL_CTK": "0", "GPU": "rtxpro6000", "DRIVER": "latest", "DRIVER_MODE": "WDDM" },
Comment thread
leofang marked this conversation as resolved.
Resolved
{ "ARCH": "amd64", "PY_VER": "3.14", "CUDA_VER": "12.9.1", "LOCAL_CTK": "0", "GPU": "a100", "DRIVER": "latest", "DRIVER_MODE": "TCC" },
{ "ARCH": "amd64", "PY_VER": "3.14", "CUDA_VER": "13.0.2", "LOCAL_CTK": "1", "GPU": "rtx4090", "DRIVER": "latest", "DRIVER_MODE": "MCDM" },
{ "ARCH": "amd64", "PY_VER": "3.14t", "CUDA_VER": "12.9.1", "LOCAL_CTK": "1", "GPU": "rtxpro6000", "DRIVER": "latest", "DRIVER_MODE": "MCDM" },
{ "ARCH": "amd64", "PY_VER": "3.14t", "CUDA_VER": "13.0.2", "LOCAL_CTK": "0", "GPU": "l4", "DRIVER": "latest", "DRIVER_MODE": "TCC" }
{ "ARCH": "amd64", "PY_VER": "3.14t", "CUDA_VER": "12.9.1", "LOCAL_CTK": "1", "GPU": "l4", "DRIVER": "latest", "DRIVER_MODE": "TCC" },
{ "ARCH": "amd64", "PY_VER": "3.14t", "CUDA_VER": "13.0.2", "LOCAL_CTK": "0", "GPU": "v100", "DRIVER": "latest", "DRIVER_MODE": "MCDM" }
],
"nightly": []
}
Expand Down
37 changes: 17 additions & 20 deletions ci/tools/install_gpu_driver.ps1

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FYI @alliepiper I backported your changes in CCCL to here 😋

Original file line number Diff line number Diff line change
Expand Up @@ -57,28 +57,25 @@ function Install-Driver {
Write-Output 'Done!'

# Handle driver mode configuration
# This assumes we have the prior knowledge on which GPU can use which mode.
$driver_mode = $env:DRIVER_MODE
if ($data_center_gpus -contains $gpu_type) {
# Data center GPUs: TCC -> MCDM
if ($driver_mode -eq "MCDM") {
Write-Output "Setting driver mode to MCDM..."
nvidia-smi -fdm 2
pnputil /disable-device /class Display
pnputil /enable-device /class Display
# Give it a minute to settle:
Start-Sleep -Seconds 5
}
} elseif ($desktop_gpus -contains $gpu_type) {
# Desktop GPUs: WDDM -> MCDM
if ($driver_mode -eq "MCDM") {
Write-Output "Setting driver mode to MCDM..."
nvidia-smi -fdm 2
pnputil /disable-device /class Display
pnputil /enable-device /class Display
# Give it a minute to settle:
Start-Sleep -Seconds 5
}
if ($driver_mode -eq "WDDM") {
Write-Output "Setting driver mode to WDDM..."
nvidia-smi -fdm 0
} elseif ($driver_mode -eq "TCC") {
Write-Output "Setting driver mode to TCC..."
nvidia-smi -fdm 1
} elseif ($driver_mode -eq "MCDM") {
Write-Output "Setting driver mode to MCDM..."
nvidia-smi -fdm 2
} else {
Write-Output "Unknown driver mode: $driver_mode"
exit 1
}
pnputil /disable-device /class Display
pnputil /enable-device /class Display
# Give it a minute to settle:

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: moment (not minute)

Start-Sleep -Seconds 5
}

# Run the functions
Expand Down