Zero-shot Knowledge Transfer via
          Adversarial Belief Matching

           Paul Micaelli                 Amos Storkey
         University of Edinburgh            University of Edinburgh
       {paul.micaelli}@ed.ac.uk            {a.storkey}@ed.ac.uk

                       Abstract
     Performing knowledge transfer from a large teacher network to a smaller student
     is a popular task in modern deep learning applications. However, due to growing
     dataset sizes and stricter privacy ...