Multiplicative Noise and Heavy Tails in Stochastic Optimization

                     Liam Hodgkinson 1 Michael W. Mahoney 1

             Abstract                 (or quenching) perspective, examines convergence either
                                  in expectation (Chen et al., 2019; Zhou et al., 2018; Gower
   Although stochastic optimization is central to        et al., 2019; Nagaraj et al., 2019; Fontaine et al., 2020) or
   modern machine learning, the precise mecha-          with some p ...