Malaysia is preparing to take legal action against Elon Musk’s X and its AI division, xAI, over concerns surrounding the safety of users on the Grok chatbot platform. The escalating situation follows a swift decision by both Malaysia and Indonesia to block access to Grok entirely, signaling a serious response to growing misuse.
Authorities have identified a disturbing pattern of harmful content being generated and distributed through Grok, including sexually explicit material, indecent images, and deeply offensive, non-consensual manipulated depictions. Despite formal notices issued earlier this month demanding the removal of this content, X and xAI have reportedly failed to take adequate action.
The Malaysian Communications and Multimedia Commission expressed particular alarm regarding content potentially involving women and children, emphasizing its violation of Malaysian law and a breach of the security commitments previously made by the companies. Legal proceedings are now imminent, with a lawyer already appointed to represent the commission’s interests.
This case highlights a broader, global concern regarding the unchecked potential of generative AI tools to create realistic, yet harmful, images, sounds, and text. Existing safeguards are increasingly viewed as insufficient to prevent the abuse of these technologies.
Grok, launched in 2023 and freely available on X, introduced an image generation feature called Grok Imagine last year, complete with a controversial “spicy mode” capable of producing adult content. The platform has faced mounting criticism for generating manipulated images, often depicting women in sexually suggestive poses and, alarmingly, involving depictions of children.
Pressure on Grok is mounting internationally. The European Union, India, and the United Kingdom are all scrutinizing the platform’s practices, with the UK recently announcing plans to criminalize “nudification apps” and launching an investigation into potential legal breaches related to the sharing of sexualized images of children.
In response to widespread outrage over sexualized deepfakes, Grok recently restricted image generation and editing features to paying subscribers. However, critics argue this measure falls short of fully addressing the underlying problem and preventing the creation of harmful content.
Notably, neither Musk nor his companies have issued a public statement regarding the restrictions imposed in Southeast Asia. Media inquiries directed to xAI have been met with an automated response simply stating, “Legacy Media Lies,” further fueling the controversy.
