Is your feature request related to a problem? Please describe.
Currently, PyTorch provides WeightedRandomSampler and DistributedSampler for the sampler arg of DataLoader, but users can't get both features together.
Describe the solution you'd like
Add DistributedWeightedRandomSampler to resample data based on weights after the distributed sampling.