Skip to content

Make EpochMetric work in DDP #978

@vfdev-5

Description

@vfdev-5

🚀 Feature

Currently, metrics like EpochMetric which store complete history of predictions and targets, are not supporting DDP setting.
Idea is to perform gather on zero rank process in compute method to accumulate all predictions and targets across all the processes and then execute metric function...
We may also need to warn about high memory consumption of this approach.

cc @sdesrozis

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions