Source: Transformer
Red-teaming exercises—the primary mechanism AI companies use to catch dangerous capabilities before deployment—have grown so haphazard and poorly standardized that they obscure rather than reveal real risks. Companies can game these internal tests to produce false assurance, while regulators and the public lack visibility into what's tested or what failures look like. Without fixing how we measure AI harm, we're asking the industry to grade its own homework while stakes rise.