AB is Investigating X Platform for Sexual Deepfakes Generated by Grok AI
The European Commission has launched an investigation into X, owned by Elon Musk, over concerns that its Grok AI is being used to create sexual deepfakes of real people. If a violation is found, the platform could face fines of up to 6% of its global annual turnover.
The European Union has launched a formal investigation into tech giant X (formerly Twitter) over sexually explicit fake videos (deepfakes) generated using its AI assistant, Grok. The investigation was initiated under the Digital Services Act (DSA).
Comprehensive Investigation and Potential High Fines
The European Commission will investigate whether the platform's algorithm was used to digitally manipulate images of real people to remove their clothing. A similar investigation was launched in January by the UK regulator, Ofcom. If found to be in violation of EU rules, company X could face a fine of up to 6% of its global annual turnover.
A previous statement from the X Safety account indicated that the platform had disabled this feature of Grok in jurisdictions where such content is illegal. However, campaigners and victims argue that the feature enabling the creation of such images should never have been implemented.
"A Violent, Unacceptable Form of Degradation"
The European Commission's Vice-President for Technology Sovereignty, Security, and Democracy, Henna Virkkunen, described sexual deepfakes as "a violent, unacceptable form of degradation." Virkkunen explained that this investigation will determine whether X is fulfilling its legal obligations under the DSA or viewing the rights of European citizens as a "collateral damage" of its service.
This development coincides with a period where the X platform is taking steps to verify users' ages. Similarly, some AI chatbots are also beginning to verify users' ages.
Platform's History and Reactions
The investigation follows the EU fining X 120 million euros last month over its blue tick badges. The Commission argued that the badges misled users because the company did not "meaningfully verify" the person behind the account.
Elon Musk criticized those scrutinizing the platform's image editing function, particularly the British government, calling it "any excuse for censorship." Prior to the Commission's announcement on Monday, Musk shared an image on X that appeared to mock the restrictions imposed on Grok.
This incident has once again brought to the fore concerns that deepfake 'undressing' technology has reached dangerous levels. Additionally, reports on the platform's failures regarding child safety had previously been made public.
International Reactions and Ongoing Reviews
X platform's AI chatbot is also under similar scrutiny in Australia, France, and Germany. Indonesia and Malaysia had imposed temporary bans on Grok, with Malaysia later lifting its ban.
The European Commission also stated that it could take "interim measures" if X refuses to implement meaningful regulations. The Commission also expanded its ongoing investigation, initiated in December 2023, into risks associated with X's recommendation systems (the algorithm that suggests specific posts to users).
