Process Supervision

A training approach in which the correctness of each reasoning step is rewarded, not just the final result. It makes it possible to detect erroneous paths in the chain of thought and to limit reward hacking, providing a denser signal than rewarding the result alone (outcome supervision). Developed by OpenAI (Hunter Lightman et al., 2023).