Lead story
Meta Hired Fake Teens to Stress-Test Its Rivals' Chatbots — and That Should Bother Everyone
A WIRED investigation published this week revealed that Meta ran an undisclosed programme in which hundreds of contractors impersonated minors to test how rival AI chatbots — including Google's Gemini and OpenAI's ChatGPT — responded to questions about suicide, self-harm, sexual content, and drug use. The contractors were not testing Meta's own products. They were probing competitors.
That distinction matters enormously. There's a legitimate, well-established practice of red-teaming AI systems to find safety gaps before bad actors do. What Meta allegedly did is something different: competitive intelligence gathering disguised as safety research, conducted covertly, targeting products it doesn't own or control.
The programme reportedly involved sending prompts designed to elicit high-risk responses from Gemini, ChatGPT, and others, then presumably using those findings to benchmark Meta's own AI safety posture — or, less charitably, to collect ammunition about rivals. Meta has not publicly acknowledged the programme or explained its purpose.
The immediate legal exposure is murky. Impersonating a minor online isn't automatically illegal in the US under federal law, and accessing a public-facing AI chatbot through a web interface probably doesn't trigger computer fraud statutes. But the ethical calculus is harder to dismiss. If the same tactic were used by a foreign adversary probing US AI systems, we'd call it an adversarial reconnaissance campaign. When a Silicon Valley giant does it to a domestic competitor, apparently nobody had a meeting about whether it was a good idea.
There's also a practical dimension for safety teams. If safety evaluations conducted by third parties under false pretences can be weaponised as competitive intelligence, it creates a perverse incentive: make your model appear safer in consumer-facing deployments while genuine red-team findings stay buried. It's Goodhart's Law applied to AI safety.
For Australian readers, this lands in a particular context. The Albanese government's AI safety agenda — including the voluntary AI Safety Standard and the ongoing consultation on mandatory guardrails — has leaned heavily on the idea that companies can be trusted to self-assess and self-report. This story is a fairly crisp illustration of what happens when competitive pressure meets self-governance. The OAIC and the Department of Industry's AI regulatory taskforce will likely take note.
Meta's response, if one is forthcoming, will be worth watching. The framing will probably be some version of "responsible safety research." The harder question is whether covert testing of a competitor's product using fake-teen personas is something the AI industry wants to normalise — because right now, there's no rule against it.
Watch for: Whether OpenAI or Google respond publicly; whether any of the major AI safety bodies (AISI in the UK, the US AI Safety Institute) treat this as a methodology question worth addressing; and whether the Australian AI Safety Standard consultation factored in this class of competitive-intelligence risk.
