Surgical Fine-Tuning
Finer Tuning: Surgical fine-tuning modifies layers based on data differences.
Fine-tuning a neural network typically involves retraining every layer on new data. But research shows that networks may perform better when fine-tuning modifies only a subset of layers.