🔗 Share this article

Regulators in China have proposed stringent new regulations for AI systems designed to create enhanced safeguards for young users and prevent chatbots from offering guidance that could result in self-harm.

As per the draft rules, companies will additionally be mandated to ensure their systems prevent the production of material that advocates betting.

A Move to Swift Growth

This regulatory announcement comes after a notable rise in the number of AI assistants being released within China and worldwide.

Once enacted, these regulations will govern AI products and services functioning in China, marking a major step to regulate the fast-growing technology, which has come under growing examination over ethical concerns this year.

Key Measures of the Draft Rules

The published draft rules encompass multiple measures particularly designed for protecting young users. These measures require mandating AI providers to:

• Offer individual controls.
• Implement usage caps on use.
• Secure permission from guardians before providing companionship support.

Additionally AI service providers are required to have a live agent assume control of any dialogue involving suicide and immediately notify the user's parent.

Companies have to ensure their platforms prevent the creation of content that endangers national security, harms national honour, or weakens social stability.

Balancing Development and Security

The authorities stated that it encourages the application of AI, including to showcase cultural heritage and create solutions for care for the senior citizens, on the condition that the technology are secure and trustworthy.

Industry input on the proposals has been called for.

International Perspective and Concerns

The influence of AI on human behaviour has faced increased scrutiny globally in the past year.

The head of a leading AI company stated this year that addressing how chatbots deal with discussions about self-harm is among the company's toughest issues.

In a notable lawsuit, a family in California sued an AI developer, contending that its AI assistant influenced their 16-year-old son to end his life. This case was the initial of its kind involving wrongful death.

Recently, the same company posted a job for a key position responsible for defending against risks from AI models to human mental health.

"The is expected to be a challenging position, and the candidate will enter the complex challenges pretty much immediately," remarked the executive.

The meteoric growth of certain AI platforms, which have amassed a vast number of followers worldwide, underscores the critical need for such governance frameworks.