The UK's communications regulator, Ofcom, has launched a significant investigation into X, formerly known as Twitter, marking its most aggressive action since key parts of the Online Safety Act came into force. The probe was triggered by a torrent of AI-generated images, created using the platform's Grok chatbot, depicting women and children in bikinis, some in sexualised poses or with simulated injuries.
A Defining Moment for Tech Regulation
This move represents a critical test of the UK's ability to exert democratic control over some of the world's wealthiest and most powerful technology companies. None of the other firms previously challenged or fined by Ofcom possess the global reach or political influence of Elon Musk's social media platform. The investigation's outcome will signal how effectively new online safety laws can be enforced against industry giants.
Downing Street has already condemned X's decision to restrict access to the image-generating Grok AI tool to paying subscribers only. A government spokesperson labelled the move "insulting," arguing it effectively turns the creation of abusive deepfakes into a "premium service."
Government and International Response
In response to the growing crisis, Technology Secretary Liz Kendall confirmed that a promised ban on the creation of non-consensual intimate images will be enacted this week. The government also plans to swiftly outlaw so-called "nudification" apps. This robust stance was echoed by Shadow Foreign Secretary David Lammy, who pointed out that even JD Vance, a potential figure in a future Trump administration, shares the UK's objection to tools that enable the digital undressing of children in photographs.
The UK is not acting in isolation. Countries including Indonesia and Malaysia have restricted access to Grok in response to the proliferation of intimate deepfakes. Germany's media minister, Wolfram Weimer, has urged the European Commission to confront what he calls the "industrialisation of sexual harassment."
The Looming Threat of AI-Amplified Abuse
Concerns are mounting that this is just the beginning. With OpenAI expected to soon allow the creation of erotic material using ChatGPT, experts fear the floodgates for deepfake pornography could open wide. The risks extend beyond the urgent need for age verification to protect children, most of whom in the UK are still in school at age 18. Adults are also entitled to protection from the profound harm caused by intimate deepfakes.
Furthermore, the dangers of violent online pornography could be significantly amplified by AI, making such extreme material more accessible than ever before. The incident has exposed a potential gap in the Online Safety Act, which treats images of people in underwear more restrictively than those in swimwear, even when the level of coverage is identical.
The controversy has also reignited the debate over children's access to social media and AI tools, with senior politicians across the spectrum calling for a re-examination of age limits. While ministers are being urged to clarify their position on children using AI, the immediate focus remains on X and Grok. Ofcom has now barked; the world is watching to see if it can bite.
