🐛 Describe the bug

Similar to : #134015

Opening this RFC to discuss CUDA version support for future PyTorch release 2.6:

Migration to CUDA 12.6 is planned for PyTorch Release 2.6.

Option 1 - CUDA 11.8 and CUDA 12.4 and 12.6
CUDA 11.8, CUDNN 9.1.0.70 - Same as Previous Release 2.5. No changes to CUDA 11.8 - Legacy version
CUDA 12.4 CUDNN 9.x - Version Released to Pypi - Stable version
CUDA 12.6 CUDNN 9.x - New Experimental version

Option 2
CUDA 12.4 CUDNN 9.x - Version Released to Pypi - Stable version
CUDA 12.6 CUDNN 9.x - New Experimental version

Open Question NCCL Update: #137978 requires us to update glibcxx. Will need to prioritoze migration to Almalinux: #123649

cc @ptrblck @msaroufim @malfet @nWEIdia @tinglvv @Skylion007 @albanD @ngimel

Versions

2.6.0