🐛 Describe the bug

Now, sympy version is 1.13.3, but torch is hard required sympy version to be 1.13.1, it will cause inconvenient in an environment which require sympy to be latest.

Versions

cc @malfet @seemethere @pytorch/pytorch-dev-infra @chauhang @penguinwu