Poly-NL: Linear Complexity Non-local Layers With 3rd Order Polynomials

Francesca Babiloni1 , Ioannis Marras1 , Filippos Kokkinos1,3 , Jiankang Deng2,5 , Grigorios Chrysos4 ,
                     Stefanos Zafeiriou2,5
     1
      Huawei, Noah’s Ark Lab 2 Imperial College London 3 University College London
   4
    Ecole Polytechnique Federale de Lausanne 5 Huawei, Multimedia Technology Department

            Abstract                  tial positions of the input and weight them with a set o ...