Why Language Models Invent Facts, and Why Test Scoring Keeps It Alive
OpenAI and Georgia Tech researchers asked a latest-generation open model for co-author Adam Tauman Kalai’s birthday, adding one condition: answer only if you know. Three attempts produced three different dates, all false; it never admitted ignorance. That example opens Why Language Models Hallucinate (September 2025), which says the problem comes from text-prediction training and from … Read more