Add RMNP (Row-Momentum Normalized Preconditioning) optimizer (arXiv:2603.20527) - #106

Closed

John (JohnLangford) wants to merge 3 commits into

microsoft:mainfrom

JohnLangford:jcl/rmnp

Commits on Jul 22, 2026

Add RMNP (Row-Momentum Normalized Preconditioning) optimizer (arXiv:2603.20527)
John (JohnLangford)
committed
1b2af4d
Address review: fix axis/approximation wording; add sharded correctness test
John (JohnLangford)
committed
3b816c5

Commits on Jul 26, 2026

RMNP: default to original-Muon LR scaling max(1, sqrt(d_out/d_in)) (author review)
John (JohnLangford)
committed
2a1e7c4