// ai reliability

All signals tagged with this topic

theme-ai ai reliability hallucinations model evaluation

Jun 13

KPMG's AI Report Cites Sources That Don't Exist

Source: The Register: Biting the hand that feeds

KPMG's flagship AI study relied on generative AI to compile citations, and when audited by GPTZero, 40 of 45 references proved fabricated or mismatched. A Big Four firm published authoritative analysis on AI risks while demonstrating the exact hallucination problem it should warn clients about. The failure exposes how consultancies are cutting corners with AI-assisted research without verification. Regulators and enterprises will cite this when evaluating whether AI-generated reports can be trusted for decision-making.

theme-ai ai reliability ai deployment failures enterprise ai

May 22

Starbucks Kills AI Inventory System After Nine Months of Counting Errors

Source: Reuters

Starbucks abandoned its automated inventory AI after deployment proved the system couldn't reliably count stock. The nine-month pilot—long enough to rule out tuning or scale issues—suggests the problem was fundamental: recognizing and categorizing physical items in chaotic store environments remains hard. This joins Amazon's hiring tool and predictive policing systems in the growing roster of high-profile AI rollbacks, each revealing how easily companies oversell automation readiness when pushing into domains that demand real-world reliability.

theme-ai agent architecture autonomous systems ai reliability

May 12

The Six-Layer Problem Most Agent Products Ignore

Source: Nate’s Substack

As AI agents move beyond narrow use cases into autonomous decision-making—particularly around commerce and transactions—the architecture of accountability is fragmenting faster than products are shipping. The visibility that came from "a human clicked a button" is dissolving across multiple layers: perception, reasoning, execution, integration, legal, social. Most deployed agents only handle the technical and execution layers, leaving responsibility gaps that will become costly once real money and liability are at stake. This is a product architecture problem, not a philosophical one. It separates companies building defensible agent systems from those building liability pipelines.