// model limitations

All signals tagged with this topic

Zoox's Autonomous Taxis Can't Handle Emergency Scenes

A Zoox robotaxi drove directly into an active fire with smoke and flames. The vehicle lacked the contextual reasoning to recognize and avoid the emergency—it followed its routing logic despite environmental signals that any human driver would interpret as impassable. The incident exposes a gap in the decision-making layer, not a sensor failure. Level 4 autonomy requires more than competence in normal driving; it demands systems that recognize when standard routing rules should be overridden.

Google's AI Overviews break on basic command words

Google's summarization feature fails on simple imperatives like "disregard," "ignore," and "skip," suggesting the underlying models either lack instruction-following capability or are overcorrecting against prompt injection. This reveals a core design tension: making AI outputs responsive to user intent versus resistant to adversarial manipulation. Google has chosen lockdown over functionality in these cases.