Malaysia and Indonesia have become the first countries to block access to Grok, the artificial intelligence chatbot developed by Elon Musk’s xAI, after authorities said it was being misused to create sexually explicit and non-consensual images.
The action highlights growing global concern over generative AI tools capable of producing realistic images, sound, and text, while current safeguards fail to prevent abuse. Grok, available through Musk’s social media platform X, has faced criticism for generating manipulated images, including sexually explicit depictions of women and children.
Regulators in both Southeast Asian countries said existing controls were insufficient to stop the creation and circulation of fake pornographic content, particularly targeting women and minors. Indonesia temporarily blocked Grok on Saturday, followed by Malaysia on Sunday.
“The government considers non-consensual sexual deepfakes a serious violation of human rights, dignity, and the safety of citizens in digital spaces,” Indonesia’s Minister of Communication and Digital Affairs, Meutya Hafid, said.
She added the move aims to protect women, children, and the wider community from AI-generated fake pornographic content.
Initial investigations revealed that Grok lacks effective safeguards to prevent users from producing and sharing pornographic material based on real photos of Indonesian residents, Alexander Sabar, director general of digital space supervision, said.
He warned such practices could violate privacy and image rights, causing psychological, social, and reputational harm.
In Malaysia, the Communications and Multimedia Commission imposed a temporary restriction on Grok following repeated misuse to produce obscene and non-consensual manipulated images, including content involving women and minors.
The regulator said previous notices to X Corp. and xAI requesting stronger safeguards largely relied on user reporting, which proved insufficient.
“The restriction is a preventive and proportionate measure while legal and regulatory processes continue,” the commission said, adding that access will remain blocked until effective safeguards are implemented.
Launched in 2023, Grok is free to use on X, allowing users to ask questions and generate content, including images through its Grok Imagine feature. A “spicy mode” added last year can produce adult content, which drew widespread criticism.
The Southeast Asian restrictions come amid mounting scrutiny of Grok in the European Union, Britain, India, and France. Last week, the platform limited image generation and editing to paying users following global backlash over sexualized deepfakes, but critics say the measures are insufficient.
