LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning

       Yuhuai Wu 1 2 Markus Rabe 3 Wenda Li 4 Jimmy Ba 1 2 Roger Grosse 1 2 Christian Szegedy 3

              Abstract                 mathematical reasoning. Attempts to design elaborate ar-
    While designing inductive bias in neural archi-       chitectures for reasoning often fall short of the performance
    tectures has been widely studied, we hypothesize      of the more generic transformer architecture. In this wor ...