// platform safety

All signals tagged with this topic

Aug 5

TikTok Withheld Safety Algorithm From 10% of US Users

Source: Bloomberg (paywall)

An internal TikTok document reveals the platform deliberately excluded roughly one in ten American users from a content-filtering system designed to limit exposure to self-harm material, creating a control group to measure engagement metrics. The company knowingly allowed vulnerable users—including a teenager who subsequently died by suicide—to be fed algorithmically amplified harmful content in service of growth testing, transforming a safety feature into a variable in a business optimization experiment. The exclusions were documented product strategy, not a bug or oversight, raising questions about whether TikTok's legal compliance efforts around teen safety have ever been genuine.

theme-culture regulation platform safety policy

Jul 4

Instagram's Ad System Promoted Child Abuse Material in India

Source: BBC

Meta's ad platform failed to block obvious CSAM keywords ("rape video," "child video") that directly monetized links to Telegram channels in a major market, exposing a gap between the company's moderation claims and enforcement at scale. This is a systematic failure in ad review mechanisms that allowed illegal content to be commercially promoted, not an isolated account or data leak. The failure raises questions about whether Meta's ad systems are designed to catch intent-based abuse or only react to reported content after the fact.

theme-consumer trust platform safety gig economy

Jul 3

Uber's 99-year background check catches criminals other platforms miss

Source: The Rideshare Guy

Uber's extended screening process flags offenders that standard seven-year checks miss, exposing how most rideshare and gig platforms operate with minimal vetting. Consumers assume platforms have done basic safety work. The economics of fast hiring and liability gaps mean most haven't, leaving riders vulnerable. For Uber, deeper screening creates a competitive advantage—other platforms either match the cost or accept the risk. Drivers themselves are now surfacing the gaps that should have been closed years ago.