Glossary · term
Mid-training
A training stage between pretraining and post-training (SFT/RLHF), involving specialized data (long context, domain data, synthetic data). Previously treated as variants of pretraining, it was carved out as a separate phase under the pressure of increasingly complex pipelines.
Training2024-25Wave 1 · 2023Maturity: 2/5
Maturity rationale
buzzword / early stage