I asked the same question on Gitter channel but didn't get a solution. So I am putting it here.

By parameters I mean like the gear of a motor, length of a part of the agent, friction etc. Is there a way to change these on the fly through mujoco-py?