This academic survey rigorously evaluates five gradient descent variants, analyzing their convergence stability, step-size sensitivity, and empirical perform...
Level: advanced
By Deng Fucheng, Wang Wanjie, Gong Ao, Wang Xiaoqi, Wang Fan
Category: research