3

Fine-tuning can cripple your foundation model; preserving features may be the solution

We analyze concept forgetting while fine-tuning foundation models and propose a simple fix to this phenomenon.