Clip

Challenges with Contrastive Learning
In order to effectively utilize contrastive learning, access to a large number of negative examples is necessary for efficient learning. Without access to a diverse pool of negatives, the learning process can become similar to online clustering.