-
Notifications
You must be signed in to change notification settings - Fork 26.3k
Open
Labels
oncall: distributedAdd this issue/PR to distributed oncall triage queueAdd this issue/PR to distributed oncall triage queuetriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate moduleThis issue has been looked at a team member, and triaged and prioritized into an appropriate module
Description
🚀 Feature
Move allgather_coalesced functionality to comm.cpp.
Motivation
allgather_coalesced does not rely on any backend specific functionality as it just uses process group's allgather. Therefore, by moving it to some more generic place we can get all supported usecases of allgather to be supported for allgather_coalesced
Additional context
This was requested as a part of review of PR 28857 #28857
cc @pietern @mrshenli @pritamdamania87 @zhaojuanmao @satgera @rohan-varma @gqchen @aazzolini @xush6528
Metadata
Metadata
Assignees
Labels
oncall: distributedAdd this issue/PR to distributed oncall triage queueAdd this issue/PR to distributed oncall triage queuetriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate moduleThis issue has been looked at a team member, and triaged and prioritized into an appropriate module