Optimal Complexity in Decentralized Training

                       Yucheng Lu 1 Christopher De Sa 1

             Abstract
                                  Table 1. Design choice of centralization and decentralization in
   Decentralization is a promising method of scal-        different layers of a parallel machine learning system. The protocol
   ing up parallel machine learning systems. In this       species how workers communicate. The topology refers to the
                              ...