Continual Learning in the Teacher-Student Setup: Impact of Task Similarity

                  Sebastian Lee 1 Sebastian Goldt 2 Andrew Saxe 3 4 5

             Abstract               1. Introduction
                                One of the biggest open challenges in machine learning is
                                the ability to effectively perform continual learning: learn-
   Continual learning—the ability to learn many       ing tasks sequentially. A significant hurdle in getting sys-
   ...