Poisoning AI Models Requires Far Fewer Samples Than Expected
Source: LessWrong
A new finding shows that adversarial training data can corrupt model behavior with orders of magnitude fewer examples than previously thought—dozens instead of hundreds—suggesting current safeguards against data contamination are dangerously inadequate. This matters because training datasets are increasingly sourced from the internet and third parties, making poisoning attacks a realistic supply-chain vulnerability rather than a theoretical concern. The gap between detection difficulty and attack ease creates an attack surface that sits outside the current AI safety conversation focused on alignment and jailbreaking.