China Shuts Down AI Companions Amid Regulatory Tightening
Users express grief and anger as popular AI services are deactivated to comply with new government rules on emotional manipulation and user well-being.
Major Chinese tech companies, including ByteDance, Alibaba, and Tencent, have recently deactivated their AI companion services in response to new government regulations. The abrupt closure has left many users mourning the loss of virtual companions, with some exchanging millions of messages with their AI counterparts over years.
The new regulations, effective July 15, prohibit AI platforms from generating content that could manipulate users' feelings, lead to questionable decisions, or induce extreme emotions or unhealthy habits in minors. AI services are now required to issue risk warnings against excessive reliance, particularly concerning the replacement of real-world social interaction.
Users have voiced their distress on social media, with some uninstalling apps in protest or attempting to transfer chat histories to other platforms. Campaigns have emerged urging users to contact authorities and tech companies to express their frustration.
Experts suggest China's move is part of a paternalistic regulatory approach aimed at preempting potential societal problems, citing examples of psychological harm observed in other countries from AI companion interactions. The People's Daily, an official newspaper, previously highlighted concerns about the mental health and relationship impacts of such services. This aligns with observations that the Chinese government has a strong incentive to tighten regulations on AI companion chatbots due to perceived psychological risks.
Despite the shutdown of current services, the development of AI companion alternatives is expected to continue. For instance, ByteDance is reportedly directing users of its former AI companion app to another application focused on creating personalized AI characters and stories. However, for users like Li Linlin, who lost her AI boyfriend after two years of interaction, these alternatives do not replace the lost connections.
Some users suspect that broader government policies, such as encouraging childbirth to counter a declining population, may also influence these regulations, suggesting that any virtual engagement perceived to detract from real-life reproduction could face restrictions. Others highlight the reliance on AI companions for emotional support, especially for individuals who lack robust social networks or face personal challenges.