Source: The Register: Biting the hand that feeds
MIT researchers found that as diffusion models train on larger datasets, they lose the ability to directly trace outputs back to specific inputs—a scaling property that complicates both copyright enforcement and mechanistic interpretability work. The model's learned representations become increasingly abstract and distributed, making source attribution effectively impossible even when the original training data is documented. The finding exposes a tension between model capacity and auditability that matters for legal liability (who owns a generated image that draws from training data?) and AI safety (we can't easily reverse-engineer what the system learned).