Why Language Models Invent Facts, and Why Test Scoring Keeps It Alive

Why Language Models Invent Facts, and Why Test Scoring Keeps It Alive

OpenAI and Georgia Tech researchers asked a latest-generation open model for co-author Adam Tauman Kalai’s birthday, adding one condition: answer only if you know. Three attempts produced three different dates, all false; it never admitted ignorance. That example opens Why Language Models Hallucinate (September 2025), which says the problem comes from text-prediction training and from … Read more

Microsoft’s Diagnostic AI Beats Generalists in a Simulation, Not in a Clinic

Microsoft’s Diagnostic AI Beats Generalists in a Simulation, Not in a Clinic

On 22 October Science published the peer-reviewed paper in which Microsoft says DxO — the Diagnostic Orchestrator announced as MAI-DxO — gets 83.2% of 304 New England Journal of Medicine cases right, against 36.1% for generalists. For emergency admissions the figures are 80.3% versus 46.8%. The paper is public, peer reviewed and explains its method. … Read more