AI Advice Inflates Confidence While Tanking Accuracy

A multi-university study found that people who consulted AI became 50% less accurate on knowledge tasks while their confidence doubled—a dangerous gap that inverts the traditional relationship between expertise and certainty. AI-assisted decision-making fails in a specific way: the technology doesn't just produce wrong answers, it produces wrong answers that users believe more strongly. This creates conditions for compounded errors in consumer choices, medical decisions, and financial planning. The dynamic also exposes a consumer psychology vulnerability that marketing and interface design can exploit or mitigate—people outsource judgment while retaining overconfidence, a combination that favors smooth-talking AI products over honest ones.