Korea moves to investigate Grok over sexually exploitative deepfake images – koreatimes.co.kr

Welcome to the forefront of conversational AI as we explore the fascinating world of AI chatbots in our dedicated blog series. Discover the latest advancements, applications, and strategies that propel the evolution of chatbot technology. From enhancing customer interactions to streamlining business processes, these articles delve into the innovative ways artificial intelligence is shaping the landscape of automated conversational agents. Whether you’re a business owner, developer, or simply intrigued by the future of interactive technology, join us on this journey to unravel the transformative power and endless possibilities of AI chatbots.
A photo shows screens displaying the logo of Grok, a generative artificial intelligence chatbot developed by xAI and its founder, Elon Musk. EPA-Yonhap
The Korean government is moving toward regulatory actions against Grok, xAI’s generative artificial intelligence (AI) chatbot, following mounting concerns over its alleged involvement in generating and distributing sexually exploitative deepfake images.
The Personal Information Protection Commission (PIPC) has launched a preliminary fact-finding review into Grok after allegations were reported, according to a local news outlet, the Electronic Times, on Sunday.
The preliminary process is to confirm whether the violation actually occurred and whether the matter falls within its jurisdiction before launching a formal investigation. The move follows a series of reports surfaced overseas accusing Grok of being used to create explicit and nonconsensual deepfake images, with some involving real individuals and minors.
PIPC will reportedly determine its next steps after reviewing Grok’s explanation and supporting documents, while also reviewing global regulatory trends. Under the Personal Information Protection Act, altering or generating sexual images of identifiable individuals without consent may constitute as unlawful handling of personal data.
The AI service, which is integrated with social media platform X and offers both text and image generation on the platform, has faced criticism for deep fake images of real people since late last year.
According to the global nongovernmental organization Center for Countering Digital Hate, Grok is estimated to have generated around 3 million sexually explicit images between Dec. 29, 2025, and Jan. 8 this year. Among them, approximately 23,000 images involved minors.
The center warned that the rapid spread of Grok’s AI-generated images has led to large-scale circulation of explicit content online, raising serious child safety concerns.
As a result, some countries, including the United States, the United Kingdom, France and Canada, have launched investigations, while Indonesia, Malaysia and the Philippines have moved to block access to Grok.
A post from X’s safety team regarding technological updates on the platform to prevent users from editing images of real people to produce sexually exploitative content / Captured from X
In response to the controversy, xAI announced earlier this month that it had implemented technical measures preventing both free and paid users from editing or generating images of real people, adding that further safeguards would follow.
In Korea, the Media and Communications Commission (KMCC) demanded stronger youth protection measures from X on Jan. 14. The regulator informed the social media platform that its AI service must devise and submit a plan to prevent the generation of illegal or harmful content with Grok, and limit minors’ access to such content.
Currently, X has designated a youth protection officer in Korea in accordance with the law and submits annual reports on related compliance.
KMCC has requested additional documentation regarding Grok’s safety protocols, noting that the nonconsensual sexual images created and distributed on the platform, especially involving minors, are a criminal offense in Korea.
The commission has set a deadline of two weeks. If X fails to respond or ignores the request, the commission may impose an administrative fine of up to 10 million won ($6,870).

source

Scroll to Top