Atlas · GenAI 2026
Catastrophic Forgetting
Catastrophic forgetting mitigation
conceptPeak: 2024Fine-TuningAI consensus: 1/3
Prerequisites
- hardLLM Fine-Tuning
Catastrophic forgetting IS a fine-tuning problem — it only occurs during fine-tuning or CPT
Recommended reference
Luo et al. (2024) 'An Empirical Study of Catastrophic Forgetting in LLMs During Continual Fine-Tuning' — practical study with mitigation strategies
Notes from AI deep research
Anthropic Opus
Model specjalizujac sie traci wiedze ogolna. LoRA (zamraza base), replay buffers, EWC
Google Deep Think
Utrata wiedzy ogólnej [G#70]
Related skills
- → is part of: Model Fine-Tuning(3/3)
- → is part of: LLM Fine-Tuning(1/3)