Official Implementation for NorMuon paper
We release our implementation in normuon.py, modified from the original Muon code. For a distributed version, we've made a PR to the Dion codebase. We also make a PR to the modded-nanogpt here.
Install directly from GitHub:
python3 -m pip install git+https://github.com/zichongli5/NorMuon.gitUsage mirrors the original Muon optimizer; please refer to their examples and details.