Noisy Student
Self-Training for Sharper Vision: The noisy student method for computer vision, explained
The previous state-of-the-art image classifier was trained on the ImageNet dataset plus 3.5 billion supplemental images from a different database. A new method achieved higher accuracy with one-tenth as many supplemental examples — and they were unlabeled, to boot.