SAC: Accelerating and Structuring Self-Attention via
      Sparse Adaptive Connection

  Xiaoya Li* , Yuxian Meng* , Mingxin Zhou , Qinghong Han , Fei Wu and Jiwei Li
            
             Computer Science Department, Zhejiang University
                    
                      Shannon.AI
   {xiaoya_li,yuxian_meng,mingxin_zhou,qinghong_han,jiwei_li}@shannonai.com

                        Abstract
     While the self-attention mechanism has been widely used in a wide variety of ta ...