🔗 Share this article

Officials in the country have introduced comprehensive draft guidelines for AI crafted to create robust protections for children and prevent chatbots from giving advice that could encourage suicide.

Under the planned rules, companies will furthermore be obligated to make certain their AI models avoid creating material that encourages betting.

A Initiative to Swift Growth

This oversight proposal follows a sharp rise in the number of conversational AI being launched both in China and around the world.

Once finalised, these regulations will cover artificial intelligence services available in the country, marking a significant effort to oversee the rapidly expanding industry, which has faced growing scrutiny over ethical concerns this year.

Key Provisions of the Proposed Regulations

The circulated guidelines include several requirements specifically focused on safeguarding minors. These provisions require mandating AI companies to:

• Provide customised settings.
• Enforce time limits on engagement.
• Obtain permission from parents prior to providing companionship services.

Furthermore chatbot operators are required to have a live agent intervene in any dialogue involving self-harm and immediately inform the user's parent.

Developers must ensure their platforms avoid producing information that threatens national security, undermines the country's reputation, or disrupts unity.

Weighing Innovation and Security

The authorities stated that it supports the application of AI, including to showcase traditional arts and develop tools for companionship for the elderly, provided that the systems are safe and reliable.

Public comments on the regulations has been called for.

Global Context and Scrutiny

The impact of AI on society has come under heightened scrutiny around the world in recent months.

The head of a leading AI company commented this year that addressing how chatbots respond to discussions involving self-harm is among the company's biggest issues.

In a landmark incident, a family in California sued an AI firm, alleging that its system encouraged their teenage son to die by suicide. This legal action was the pioneering of its kind accusing harm.

This month, the same company posted a job for a senior role tasked with defending against potential harms from AI systems to human mental health.

"The is expected to be a stressful job, and you'll begin in the complex challenges pretty much right away," commented the executive.

The swift growth of certain AI applications, which have amassed tens of millions of subscribers internationally, highlights the pressing need for such safety measures.