Using Statistics to Automate Stochastic Optimization

            Hunter Lang  Pengchuan Zhang  Lin Xiao
                 Microsoft Research AI
                Redmond, WA 98052, USA
          {hunter.lang, penzhan, lin.xiao}@microsoft.com

                        Abstract
     Despite the development of numerous adaptive optimizers, tuning the learning
     rate of stochastic gradient methods remains a major roadblock to obtaining good
     practical performance in machine learning. Rather than ...