Neural Multisensory Scene Inference

         Jae Hyun Lim§123 , Pedro O. Pinheiro1 , Negar Rostamzadeh1 ,
                Christopher Pal1234 , Sungjin Ahn§5
  1
   Element AI, 2 Mila, 3 Université de Montréal, 4 Polytechnique Montréal, 5 Rutgers University

                       Abstract
     For embodied agents to infer representations of the underlying 3D physical world
     they inhabit, they should efficiently combine multisensory cues from numerous
     trials, e.g., by looking at and  ...