papersSEP 11 04:00 UTC
DP-Muon: Differentially Private Optimization with Matrix-Orthogonalized Momentum
A new arXiv paper introduces DP-Muon, an optimizer that combines matrix-orthogonalized momentum with differential privacy guarantees. The method relies on standard per-example gradient clipping and releases one Gaussian-noised gradient per step, treating the matrix and auxiliary updates as post-processing. The authors present a convergence analysis for this approach.