The difficulty with self-supervised learning lies in representing uncertainty, multiple outcomes and unpredictability. Although vision appears to be less challenging than language for achieving full self-supervised learning capability, the challenges still remain vast.