Skip to content

Update PyTorch to 2.7.1+cu128 for RTX 50 Series GPU Support - #354

Merged
fireblade2534 merged 1 commit into
remsky:masterfrom
MiggiV2:master
Jul 4, 2025
Merged

fireblade2534 merged 1 commit into
remsky:masterfrom
MiggiV2:master

Conversation

@MiggiV2

@MiggiV2 MiggiV2 commented Jun 27, 2025

Copy link
Copy Markdown
Contributor

Motivation

This PR updates PyTorch from version 2.6.0+cu124 to 2.7.1+cu128 to support newer GPU architectures, specifically the RTX 50 series cards (RTX 5070, etc.). The current PyTorch version lacks support for these latest GPUs, preventing users with newer hardware from using the application.

Changes

  • pyproject.toml: Updated PyTorch dependency from torch==2.6.0+cu124 to torch==2.7.1+cu128
  • Dockerfile: Updated CUDA base image from version 12.8.0 to 12.8.1 to match the PyTorch CUDA requirements

Testing

  • ✅ Tested containerized deployment - works correctly
  • ✅ Tested non-Docker deployment - works correctly
  • ✅ Verified GPU functionality - RTX 5070 now supported
  • ✅ Verified CPU fallback - continues to work as expected

Related Issues

Fixes #344 - Request for different CUDA version containers for RTX 5000 series support
Fixes #320 - Compatibility issue with RTX 50 Series cards due to outdated PyTorch version

Benefits

  • Enables support for RTX 50 series GPUs out of the box
  • Reduces the need for users to manually rebuild containers
  • Maintains backward compatibility with existing GPU configurations
  • Improves environmental impact by providing pre-built containers instead of requiring individual rebuilds

This update ensures that users with the latest GPU hardware can use the application without manual modifications while maintaining compatibility with existing setups.

@atkinsjb

Copy link
Copy Markdown

@fireblade2534 +1 for this PR. I would very much like this to work on my 5060

@realugbun

Copy link
Copy Markdown

I built the GPU container from MiggiV2's PR. Wow. Blazing fast on Blackwell! Please merge this PR so we can get all the updates. The PR is already a few commits behind main.

@fireblade2534

Copy link
Copy Markdown
Collaborator

Nice work thx

@fireblade2534
fireblade2534 merged commit 29066f7 into remsky:master Jul 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Please release different CUDA version containers Doesn't work on the latest RTX 50 Series cards due to Python Torch version

4 participants