Compute Wall / Data Wall

Barriers to scaling pretrained models. Compute Wall: limits on available GPUs plus electricity (Microsoft/OpenAI's Stargate $500B in response). Data Wall: the exhaustion of "high-quality" internet data (Epoch AI 2024). Together they drive the shift to test-time compute, synthetic data, and RLVR. They define AI's "post-pretraining era."