Conservation Law Breaking at the Edge of Stability: A Spectral Theory of Non-Convex Neural Network Optimization
This research paper rigorously investigates the spectral theory behind non-convex neural network optimization, revealing how gradient descent preserves conse...