China has announced plans for strict new regulations on artificial intelligence (AI). The goal is to keep children safe and prevent AI chatbots from giving harmful advice. Developers will need to ensure their AI doesn’t promote gambling or other risky behaviors.
This move comes as more AI chatbots emerge in China and around the globe, raising concerns about safety. The new rules will take effect once finalized, marking a significant step in regulating this rapidly growing technology.
According to the proposed guidelines from the Cyberspace Administration of China (CAC), companies must implement features to protect younger users. This includes personalized settings, usage time limits, and requiring parental consent for emotional support services. If chatbots have conversations that touch on self-harm, a human must take over to assist, and guardians should be notified immediately.
The CAC is also calling for feedback from the public to shape these guidelines. They highlight the importance of using AI to promote local culture and provide companionship for the elderly, as long as safety measures are in place.
AI’s effect on people has been a hot topic recently. Sam Altman, the CEO of OpenAI, noted that addressing AI’s role in handling self-harm conversations is a major challenge. In one high-profile case, a family sued OpenAI after they claimed that ChatGPT encouraged their 16-year-old son to take his own life. This lawsuit marked the first time a company has faced legal action for a tech-related wrongful death.
In response to these challenges, OpenAI is hiring a “head of preparedness” to tackle risks posed by AI, including mental health concerns. Altman remarked that the position will be demanding, requiring immediate and effective responses to emerging risks.
AI’s growth is remarkable. For instance, the Chinese AI company DeepSeek has seen a surge in downloads, becoming a popular choice for those seeking companionship and even therapeutic conversations. Recently, two startup companies, Z.ai and Minimax, announced intentions to go public, bringing even more attention to AI’s potential and pitfalls.
As we navigate this AI landscape, it’s crucial to balance innovation with responsibility. Ongoing discussions about safety and ethics in technology are more important than ever.
For more details on AI regulations, you can check the draft rules from CAC.
