China Proposes AI Companion Regulations

China's Cyberspace Administration of China (CAC) proposed new regulations this week to govern the rapidly expanding market for AI-powered companion services. The draft rules, released on June 11, 2024, aim to address ethical concerns and potential societal impacts associated with AI companions, which are designed to interact with users in ways that mimic human relationships. These regulations are intended to provide a framework for the development, deployment, and management of such technologies.

The proposed guidelines cover several key areas, including data privacy, content moderation, and the prevention of harmful or deceptive practices. The CAC stated that AI companions must not generate content that incites subversion of state power, undermines national unity, or promotes terrorism. They must also avoid content that is obscene, violent, or discriminatory. Furthermore, the regulations stipulate that AI companions should not engage in activities that could lead to addiction or financial exploitation of users.

Developers and providers of AI companion services will be required to conduct security assessments and register their products with the authorities. The rules also emphasize the importance of transparency, requiring that users are clearly informed that they are interacting with an AI and not a human. The CAC is seeking public feedback on the draft regulations until July 11, 2024, indicating a commitment to a consultative approach before finalizing the rules. This move by China signifies a proactive stance in managing the ethical and social implications of advanced AI technologies.