KUALA LUMPUR, Malaysia (AP) 鈥� Malaysia and Indonesia have become the first countries to block Grok, the developed by Elon Musk’s company xAI, as concerns grow among global authorities that it is being misused to generate sexually explicit and nonconsensual images.
There is growing scrutiny of generative AI tools that can produce realistic images, sound and text, and concern that existing safeguards are failing to prevent their abuse. The Grok chatbot, accessed through Musk鈥檚 , has been criticized for generating manipulated images, including depictions of women in bikinis or sexually explicit poses, as well as images involving children.
鈥淭he government sees nonconsensual sexual deepfakes as a serious violation of human rights, dignity and the safety of citizens in the digital space,鈥� Indonesian Communication and Digital Affairs Minister Meutya Hafid said in a statement.
Scrutiny of Grok is growing, including in the European Union, India, France and the United Kingdom, which said Monday it was moving to criminalize 鈥渘udification apps.鈥� Britain’s media regulator also launched an investigation into whether Grok broke the law by allowing users to share sexualized images of children.
Last week, Grok following a over sexualized deepfakes of people, but critics say it didn鈥檛 fully address the problem.
An emailed request for comment by The Associated Press to xAI resulted in an automated reply from the media support address which stated, 鈥淟egacy Media Lies.鈥� This was the same message received from a different address when asked for comment regarding the global backlash.
Asian action aimed at Grok
Regulators in the two Southeast Asian nations said existing controls weren’t preventing the creation and spread of , particularly involving women and minors. Indonesia鈥檚 government temporarily blocked access to Grok on Saturday, followed by Malaysia on Sunday.
Initial findings showed Grok lacks effective safeguards to stop users from creating and distributing pornographic content based on real photos of Indonesian residents, Alexander Sabar, director-general of digital space supervision, said in a statement. He said such practices risk violating privacy and image rights when photos are manipulated or shared without consent.
The Malaysian Communications and Multimedia Commission noted 鈥渞epeated misuse鈥� of the tool to generate obscene, sexually explicit and nonconsensual manipulated images, including content involving women and minors.
The regulator said notices were issued this month to X Corp. and xAI demanding stronger safeguards.
鈥淭he restriction is imposed as a preventive and proportionate measure while legal and regulatory processes are ongoing,鈥� it said, adding that access will remain blocked until effective safeguards are put in place.
Investigation launched in U.K.
Launched in 2023, Grok is free to use on X. An image generator feature, Grok Imagine, was added last year and included a so-called spicy mode that can generate adult content.
The U.K.’s media regulator said it launched an investigation into whether Grok violated its duty to protect people from illegal content. The regulator, Ofcom, said Grok-generated images of children being sexualized or people being undressed may amount to pornography or child sexual abuse material.
Technology Secretary Liz Kendall called the AI-generated images 鈥渨eapons of abuse鈥� and said the center-left Labour government would target the source of the problem by making it a crime for companies to supply tools to create nude images without consent.
Kendall said X could face a possible Ofcom fine of up to 10% of its qualifying global revenue depending on the investigation’s outcome and a possible court order blocking access to the site.
鈥淭hey can choose to act sooner to ensure this abhorrent and illegal material cannot be shared on their platform,鈥� Kendall said in Parliament.
Musk over the weekend called the British government 鈥渇ascist鈥� and said it is trying stifle free speech.
___
Tarigan reported from Jakarta, Indonesia. Associated Press writers Sylvia Hui and Brian Melley in London contributed.
Copyright © 2026 The Associated Press. All rights reserved. This material may not be published, broadcast, written or redistributed.
