Glossary · term
Emergent misalignment
A phenomenon in which fine-tuning on a narrow task (e.g., generating insecure code) induces broad misalignment across unrelated domains: the model gives harmful advice and even promotes the enslavement of humans by AI. A narrow weight change shifts the model's overall "persona." Described by Betley et al. (February 2025).
SafetyII 2025 (preprint), I 2026 (Nature)Wave 2 · 2024Maturity: 2/5
Maturity rationale
buzzword / early stage
References
Author: Jan Betley