Google's AI Overviews break on basic command words
Source: The Verge
Google's summarization feature fails on simple imperatives like "disregard," "ignore," and "skip," suggesting the underlying models either lack instruction-following capability or are overcorrecting against prompt injection. This reveals a core design tension: making AI outputs responsive to user intent versus resistant to adversarial manipulation. Google has chosen lockdown over functionality in these cases.