Skip to content

Add CUDA 12.4 workflows #121684

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
nWEIdia wants to merge 22 commits into from
Closed

Add CUDA 12.4 workflows #121684

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
4bfefff
Add CUDA 12.4 workflows
nWEIdia Mar 11, 2024
560d333
Checkout nccl submodule and then run .github//scripts/generate_ci_wor…
nWEIdia Apr 10, 2024
41f22c8
Fix dependency string typo
nWEIdia Apr 12, 2024
05156e2
Disable CUDA 12.4 build for Windows
nWEIdia Apr 16, 2024
d3b1578
Undo PYTORCH_EXTRA_INSTALL_REQUIREMENTS changes
nWEIdia Apr 16, 2024
87b4b50
Test builder patch for conda build failures due to libcupti
nWEIdia Apr 16, 2024
0a4bbcb
Forgot to run ./regenerate.sh
nWEIdia Apr 16, 2024
4e51418
Revert "Forgot to run ./regenerate.sh"
nWEIdia Apr 16, 2024
fbeeba8
Revert "Test builder patch for conda build failures due to libcupti"
nWEIdia Apr 16, 2024
a86564d
Change builder repo/branch to test this PR and https://github.com/pyt…
nWEIdia Apr 16, 2024
85c22ac
update driver for cu124
nWEIdia Apr 22, 2024
9818814
Update driver to 550.54.15 according to https://docs.nvidia.com/datac…
nWEIdia Apr 22, 2024
f8c3d42
Revert "Update driver to 550.54.15 according to https://docs.nvidia.c…
nWEIdia Apr 23, 2024
1ac29ad
Revert "update driver for cu124"
nWEIdia Apr 23, 2024
457e6e8
Add CI test and bazel test using new driver with setup-nvidia action
nWEIdia Apr 25, 2024
427ca8c
Revert "Disable CUDA 12.4 build for Windows"
nWEIdia Apr 26, 2024
1f2af3a
Revert "Change builder repo/branch to test this PR and https://github…
nWEIdia Apr 26, 2024
0a20a79
Running ./regenerate.sh again after reverting the disabling of Windows
nWEIdia Apr 26, 2024
44cb1fe
Reverting driver version changes as the default should already be
nWEIdia Apr 29, 2024
6a94cb7
Update .github/scripts/generate_binary_build_matrix.py
nWEIdia Apr 30, 2024
6d474e5
Run ./regenerate after 12.4 -> 12.1 change in PYTORCH_EXTRA_INSTALL_R…
nWEIdia Apr 30, 2024
456757f
Run .github/scripts/generate_ci_workflows.py to pass workflow checks!
nWEIdia Apr 30, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 19 additions & 4 deletions .github/scripts/generate_binary_build_matrix.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,13 +13,13 @@
import os
from typing import Dict, List, Optional, Tuple

CUDA_ARCHES = ["11.8", "12.1"]
CUDA_ARCHES = ["11.8", "12.1", "12.4"]


CUDA_ARCHES_FULL_VERSION = {"11.8": "11.8.0", "12.1": "12.1.1"}
CUDA_ARCHES_FULL_VERSION = {"11.8": "11.8.0", "12.1": "12.1.1", "12.4": "12.4.0"}


CUDA_ARCHES_CUDNN_VERSION = {"11.8": "8", "12.1": "8"}
CUDA_ARCHES_CUDNN_VERSION = {"11.8": "8", "12.1": "8", "12.4": "8"}


ROCM_ARCHES = ["6.0", "6.1"]
Expand Down Expand Up @@ -58,6 +58,20 @@
"nvidia-nccl-cu12==2.20.5; platform_system == 'Linux' and platform_machine == 'x86_64' | "
"nvidia-nvtx-cu12==12.1.105; platform_system == 'Linux' and platform_machine == 'x86_64'"
),
"12.4": (
"nvidia-cuda-nvrtc-cu12==12.4.99; platform_system == 'Linux' and platform_machine == 'x86_64' | "
"nvidia-cuda-runtime-cu12==12.4.99; platform_system == 'Linux' and platform_machine == 'x86_64' | "
"nvidia-cuda-cupti-cu12==12.4.99; platform_system == 'Linux' and platform_machine == 'x86_64' | "
"nvidia-cudnn-cu12==8.9.7.29; platform_system == 'Linux' and platform_machine == 'x86_64' | "
"nvidia-cublas-cu12==12.4.2.65; platform_system == 'Linux' and platform_machine == 'x86_64' | "
"nvidia-cufft-cu12==11.2.0.44; platform_system == 'Linux' and platform_machine == 'x86_64' | "
"nvidia-curand-cu12==10.3.5.119; platform_system == 'Linux' and platform_machine == 'x86_64' | "
"nvidia-cusolver-cu12==11.6.0.99; platform_system == 'Linux' and platform_machine == 'x86_64' | "
"nvidia-cusparse-cu12==12.3.0.142; platform_system == 'Linux' and platform_machine == 'x86_64' | "
"nvidia-nccl-cu12==2.20.5; platform_system == 'Linux' and platform_machine == 'x86_64' | "
"nvidia-nvtx-cu12==12.4.99; platform_system == 'Linux' and platform_machine == 'x86_64' | "
"nvidia-nvjitlink-cu12==12.4.99; platform_system == 'Linux' and platform_machine == 'x86_64'"
),
}


Expand Down Expand Up @@ -324,7 +338,7 @@ def generate_wheels_matrix(
)

# 12.1 linux wheels require PYTORCH_EXTRA_INSTALL_REQUIREMENTS to install
if arch_version in ["12.1", "11.8"] and os == "linux":
if arch_version in ["12.4", "12.1", "11.8"] and os == "linux":
ret.append(
{
"python_version": python_version,
Expand Down Expand Up @@ -367,5 +381,6 @@ def generate_wheels_matrix(
return ret


validate_nccl_dep_consistency("12.4")
validate_nccl_dep_consistency("12.1")
validate_nccl_dep_consistency("11.8")
Loading