Test-Time Compute

Additional computational resources allocated during inference to improve model performance on difficult problems. Reasoning models like OpenAI's o1 and o3 use test-time compute to think longer before answering, trading speed for accuracy. This paradigm suggests that scaling inference compute may be as important as scaling training compute.