Unbiased Gradient Estimation in Unrolled Computation Graphs
             with Persistent Evolution Strategies

                   Paul Vicol 1 2 Luke Metz 2 Jascha Sohl-Dickstein 2

             Abstract                 Zipser, 1989; Tallec & Ollivier, 2017a; Mujika et al., 2018;
    Unrolled computation graphs arise in many sce-        Benzing et al., 2019; Marschall et al., 2019; Menick et al.,
    narios, including training RNNs, tuning hyperpa-       2020) gradient accumulation. These method ...