-
-
Notifications
You must be signed in to change notification settings - Fork 692
Make EpochMetric work in DDP #978
Copy link
Copy link
Closed
Labels
Description
🚀 Feature
Currently, metrics like EpochMetric which store complete history of predictions and targets, are not supporting DDP setting.
Idea is to perform gather on zero rank process in compute method to accumulate all predictions and targets across all the processes and then execute metric function...
We may also need to warn about high memory consumption of this approach.
cc @sdesrozis
Reactions are currently unavailable