Adaptive Stepsizing for Stochastic Gradient Langevin Dynamics in Bayesian Neural Networks

SA-SGLD introduces a novel adaptive stepsizing mechanism for Stochastic Gradient Langevin Dynamics, dynamically adjusting to local gradient norms to stabiliz...

Level: expert

By Rajit Rajpal, Benedict Leimkuhler, Yuanhao Jiang

Category: research