3

Fine-tuning can cripple your foundation model; preserving features may be the solution

We analyze and benchmark concept forgetting in foundation model fine-tuning and propose a simple fix to this phenomenon.