Global Low-Rank, Local Full-Rank: The Holographic Encoding of Learned Algorithms

This research establishes that neural networks achieve grokking via holographic encoding across all parameters, utilizing trajectory-based PCA to reveal low-...

Level: expert

By Yongzhong Xu

Category: research