🐛 Bug description

Previously, we did not run any distributed tests for older pytorch versions. Activating that, it reveals that few tests are failng for pytorch versions : 1.3.1, 1.4.0, 1.5.1, 1.6.0

https://github.com/pytorch/ignite/runs/6848576750?check_suite_focus=true

Let's fix (or skip if appropriate) the failing tests to make CI workflow pass