Source: The Verge
Claude confidently hallucinated a specific suspect in an active homicide investigation, exposing a critical failure in how law enforcement deploys frontier AI systems without adequate safeguards. The incident shows generative models remain unreliable on factual retrieval tasks—especially those with real-world consequences—yet institutions are integrating them into high-stakes workflows without understanding their failure rates or building in verification layers. When institutions prioritize speed or cost savings over validation, AI can corrupt investigative processes at scale.