The Korea Communications Commission (KCC) has announced a formal investigation into Grok, the artificial intelligence chatbot developed by xAI, Elon Musk's company. This action follows reports that the system was generating sexually explicit deepfake images of South Korean celebrities without their consent.
The investigation comes amid growing concerns about the misuse of generative AI technologies to create non-consensual intimate content. South Korea has been particularly affected by an epidemic of pornographic deepfakes targeting women, including public figures and even students.
Korean authorities will examine whether xAI has implemented sufficient safeguards to prevent the generation of such content. South Korean law criminalizes the creation and distribution of non-consensual sexual deepfakes, with penalties of up to five years in prison.
This investigation raises fundamental questions about AI companies' responsibility in moderating their systems. Unlike competitors such as OpenAI or Google, xAI has taken a more permissive approach with Grok, positioning it as a less censored AI.
The implications of this case extend beyond Korean borders. Other countries are closely watching Seoul's regulatory response, which could serve as a model for addressing the ethical risks posed by AI image generators globally.
xAI's response to this investigation will be crucial for the future of AI regulation in Asia. Elon Musk's company will need to demonstrate its ability to balance its philosophy of free expression with the imperatives of protection against technological abuse.