In ignite 0.2.1, PiecewiseLinear didn't expect the optimizer to be strictly a sub-class of torch.optim.Optimizer and allowed generic parameter group dicts as well.

But it looks like in later versions, this generic support was withdrawn.

What's the context behind this change?

I had been successfully using PiecewiseLinear from ignite 0.2.1 along with Microsoft's DeepSpeed ZeRO optimizer, which isn't strictly a sub-class of torch.optim.Optimizer and Microsoft addressed the reasons for this in their repo. However, due to some useful features in later versions of ignite, we decided to upgrade to a newer version of ignite (0.3 and later also 0.4). In the process of this upgrade, we realized PiecewiseLinear no longer works with the ZeRO optimizer.

It would be great if support for generic parameter group dicts is added back.