Describe the bug
In UnetResBlock, conv and norm layers are created even if downsample is not used. This can lead to having unused parameters, hence creating issues with DDP and other procedures.

The better solution is to make conv and norm layer creation conditional on downsample.