Study notes: Well-behaved training in Deep Neural Networks
Published:
Study notes for The lazy (NTK) and rich (µP) regimes: A gentle tutorial by Dhruva Karkada and A Spectral Condition for Feature Learning by Greg Yang, James B. Simon and Jeremy Bernstein.