On the Expressive Power of
            Deep Polynomial Neural Networks

         Joe Kileel         Matthew Trager          Joan Bruna
      Princeton University      New York University       New York University

                         Abstract
       We study deep neural networks with polynomial activations, particularly their
       expressive power. For a fixed architecture and activation degree, a polynomial
       neural network defines an algebraic map from weights to polynomials. The ...