// model transparency

All signals tagged with this topic

Open Weights Aren't Open Source — The AI Industry's Mislabeling Problem

The AI industry has weaponized "open" to describe model weights lacking source code, training data, and modification rights central to open source software. This creates a marketing category that grants users access without agency. Companies like Meta and Mistral claim openness while controlling model training pipelines, data provenance, and commercial redistribution—selling the appearance of transparency while gatekeeping the infrastructure that determines what these systems learn. As open weights proliferate, the semantic collapse between "downloadable" and "open" erodes actual open source norms and gives enterprises cover to shape AI development without the accountability genuine openness requires.

Anthropic's Watermarks Expose EU AI Regulation's Toothlessness

Anthropic's deployment of easily-defeated watermarks to comply with the EU AI Act exposes a regulatory gap: the rule requires outputs be identifiable as AI-generated but sets no technical standards or audit mechanisms. Companies can satisfy the requirement while leaving watermarks trivial to strip. Vague mandates without enforcement architecture become compliance theater—a checkbox that neither users nor regulators will meaningfully act on. Unless the EU establishes specific technical requirements or third-party verification, the pattern will repeat across other regulations.

Anthropic's AI Watermarking Plan Misses the Real Problem

Anthropic is implementing watermarking for EU compliance—a technical fix that treats AI regulation as a copyright problem when the actual risks (deception, misuse, autonomous harm) operate on different vectors. The mechanism may be theoretically sound but becomes worse than useless once you recognize that watermarks can be stripped, circumvented, or spoofed by the actors regulators actually worry about, while creating a false sense of control that delays harder conversations about AI capability disclosure and audit rights.