FewNLU
Fine-Tune Your Fine-Tuning: New method optimizes training for few shot NLP models.
Let’s say you have a pretrained language model and a small amount of data to fine-tune it to answer yes-or-no questions. Should you fine-tune it to classify yes/no or to fill in missing words — both viable approaches that are likely to yield different results?