Skip to content

Conversation

@HollowMan6
Copy link
Contributor

In torch v2.8.0, all symm mem code are moved into a dedicated folder pytorch/pytorch@ffc6cbf

So this PR tries to address this change by checking if we have it located under torch/csrc/distributed/c10d/symm_mem/SymmetricMemory.hpp (new location). If not, we fall back to the original place for backward compatibilities.

This PR also clean up some includes in z1/2/3.cpp that has already been included in deepcompile.h

@HollowMan6 HollowMan6 requested a review from tjruwase as a code owner June 30, 2025 16:59
In torch v2.8.0, all symm mem code are moved into a dedicated folder
pytorch/pytorch@ffc6cbf

So this PR tries to address this change by checking if we have it
located under `torch/csrc/distributed/c10d/symm_mem/SymmetricMemory.hpp`
(new location). If not, we fall back to the original place for backward
compatibilities.

This PR also clean up some includes in `z1/2/3.cpp` that has already been
included in `deepcompile.h`

Signed-off-by: Hollow Man <[email protected]>
@tohtana tohtana enabled auto-merge (squash) June 30, 2025 18:02
@tohtana
Copy link
Collaborator

tohtana commented Jun 30, 2025

Looks good to me. Thank you for your contribution, @HollowMan6!

@tohtana tohtana self-requested a review June 30, 2025 18:04
@tohtana tohtana merged commit 384e6d3 into deepspeedai:master Jun 30, 2025
9 checks passed
lpnpcs pushed a commit to lpnpcs/DeepSpeed that referenced this pull request Jul 30, 2025
In torch v2.8.0, all symm mem code are moved into a dedicated folder
pytorch/pytorch@ffc6cbf

So this PR tries to address this change by checking if we have it
located under `torch/csrc/distributed/c10d/symm_mem/SymmetricMemory.hpp`
(new location). If not, we fall back to the original place for backward
compatibilities.

This PR also clean up some includes in `z1/2/3.cpp` that has already
been included in `deepcompile.h`

Signed-off-by: Hollow Man <[email protected]>
mauryaavinash95 pushed a commit to DataStates/DeepSpeed that referenced this pull request Oct 4, 2025
In torch v2.8.0, all symm mem code are moved into a dedicated folder
pytorch/pytorch@ffc6cbf

So this PR tries to address this change by checking if we have it
located under `torch/csrc/distributed/c10d/symm_mem/SymmetricMemory.hpp`
(new location). If not, we fall back to the original place for backward
compatibilities.

This PR also clean up some includes in `z1/2/3.cpp` that has already
been included in `deepcompile.h`

Signed-off-by: Hollow Man <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants