Second-Order, First-Class: A Composable Stack for Curvature-Aware Training

This research introduces Somax, a composable stack that simplifies second-order optimization by treating curvature-aware training as a single JIT-compiled st...

Level: advanced

By Mikalai Korbit, Mario Zanon

Category: research