Skip to content

Conversation

@tianleiwu
Copy link
Contributor

Description

Exclude cuDNN 9 and CUDA 12 DLLs from manylinux wheel to reduce python package size.

Motivation and Context

The 1.20.0 ort-nightly-gpu python wheels on linux are suddenly > 800 MB in size. The wheels built on 1.19 release branch have a size of around 220 MB.

The size change is caused by #19470.

@mszhanyi
Copy link
Contributor

@tianleiwu
Copy link
Contributor Author

@mszhanyi, I will add another PR for cuDNN 8 and CUDA 11 DLLs.

@tianleiwu tianleiwu merged commit 212bcc9 into main Aug 15, 2024
@tianleiwu tianleiwu deleted the tlwu/add_cudnn_dll_dependencies_in_setup branch August 15, 2024 07:03
tianleiwu added a commit that referenced this pull request Aug 15, 2024
### Description
It is a follow up of #21738
to exclude cudnn 8 DLLs since some python packaging pipelines (like
training package) are still using cudnn 8.9 and cuda 11.8.

### Motivation and Context

Size of python package for training pipeline increases a lot due to some
DLLs are added to package:

![image](https://github.com/user-attachments/assets/643a808e-760b-4382-ba55-57d7d722ee9a)
@snnn
Copy link
Contributor

snnn commented Oct 11, 2024

The line with libnvrtc-builtins is wrong.

rohan11235813 pushed a commit to quadric-io/onnxruntime that referenced this pull request Aug 19, 2025
### Description
It is a follow up of microsoft/onnxruntime#21738
to exclude cudnn 8 DLLs since some python packaging pipelines (like
training package) are still using cudnn 8.9 and cuda 11.8.

### Motivation and Context

Size of python package for training pipeline increases a lot due to some
DLLs are added to package:

![image](https://github.com/user-attachments/assets/643a808e-760b-4382-ba55-57d7d722ee9a)
rohan11235813 pushed a commit to quadric-io/onnxruntime that referenced this pull request Sep 15, 2025
### Description
It is a follow up of microsoft/onnxruntime#21738
to exclude cudnn 8 DLLs since some python packaging pipelines (like
training package) are still using cudnn 8.9 and cuda 11.8.

### Motivation and Context

Size of python package for training pipeline increases a lot due to some
DLLs are added to package:

![image](https://github.com/user-attachments/assets/643a808e-760b-4382-ba55-57d7d722ee9a)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants