Benchmarks
Better Performance From Merged Models: Localize-and-Stitch improves methods for merging and fine-tuning multiple models
Merging multiple fine-tuned models is a less expensive alternative to hosting multiple specialized models. But, while model merging can deliver higher average performance across several tasks, it often results in lower performance on specific tasks. New work addresses this issue.