Implicit Bias of Linear RNNs

Melikasadat Emami 1 Mojtaba Sahraee-Ardakan 1 2 Parthe Pandit 1 2 Sundeep Rangan 3 Alyson K. Fletcher 1 2

              Abstract                 networks have become ubiquitous in practical applications,
    Contemporary wisdom based on empirical studies        several theoretical aspects of them largely remain a mystery.
    suggests that standard recurrent neural networks       Of significant importance is the lack of understanding of the
    (RNNs) do not perfor ...