🚀 Feature

Idea is to add run Horovod tests on CPU via Github Actions. We can either: 1) install horovod using pip or 2) otherwise compile horovod from source as it is done for Circle CI (without NCCL support). The goal is to be able to run CPU distributed tests with Horovod backend.

TODO:

• create new file hvd-tests.yml in .github/workflows like https://github.com/pytorch/ignite/blob/master/.github/workflows/tpu-tests.yml
• setup horovod (described above)
• run horovod tests like in circle ci yaml

Quick play around github actions can be done in a separate repository like https://github.com/vfdev-5/github-actions-playground