Glossary · term

Mid-training

A training stage between pretraining and post-training (SFT/RLHF), involving specialized data (long context, domain data, synthetic data). Previously treated as variants of pretraining, it was carved out as a separate phase under the pressure of increasingly complex pipelines.

Training2024-25Wave 1 · 2023Maturity: 2/5

Maturity rationale

buzzword / early stage