From Muon to Gradient Clipping: Some Thoughts on QK Stability

 (MasterGodzilla.github.io)

28 points | by Eridanus2 7 days ago

0 comments