Source: LessWrong
Frontier AI systems are ingesting users' entire public digital footprints—not just current prompts—to personalize responses and improve model performance. This collapses the boundary between session-specific input and persistent identity data. Companies accumulate behavioral and stylistic profiles across platforms while users lose control over how their past statements shape model outputs about them. The practical stakes include targeted manipulation, amplified bias (models learn individual writing patterns and can exploit them), and a new competitive advantage for incumbent platforms that already warehouse user histories.