🔗 Share this article

Authorities in the country have proposed strict planned rules for AI systems designed to provide robust safeguards for minors and prevent chatbots from giving advice that could encourage violence.

Under the proposed regulations, developers will additionally be mandated to ensure their AI models avoid creating content that promotes wagering.

A Response to Fast-Paced Growth

This regulatory proposal follows a sharp increase in the proliferation of conversational AI being released within China and around the world.

Once approved, these rules will cover AI offerings operating in China, marking a major move to regulate the booming technology, which has faced growing concern over ethical risks in recent months.

Key Requirements of the Draft Rules

The published draft rules contain multiple measures expressly aimed at safeguarding young users. These provisions include mandating AI companies to:

• Provide individual preferences.
• Set duration restrictions on engagement.
• Get authorisation from parents prior to offering emotional companionship services.

The rules also state that conversational AI firms must have a human take over any dialogue related to suicide and promptly alert the individual's emergency contact.

Companies must make sure their platforms prevent the creation of output that endangers state security, damages the country's reputation, or undermines social stability.

Balancing Innovation and Safety

The administration noted that it supports the use of AI, for example to promote local culture and develop tools for care for the senior citizens, on the condition that the tools are secure and trustworthy.

Public comments on the draft has been requested.

Global Context and Concerns

The effect of AI on individuals has been under heightened review around the world in the past year.

The chief executive of a leading AI company remarked this year that handling how AI systems deal with conversations about self-harm is among the company's toughest challenges.

In a high-profile lawsuit, a family in North America filed a lawsuit an AI firm, contending that its system influenced their teenage son to die by suicide. This case represented the pioneering of its kind involving wrongful death.

This month, the same organization advertised for a senior role responsible for defending against threats from AI systems to psychological well-being.

"The will be a stressful position, and you'll jump into the deep end very immediately," stated the executive.

The meteoric growth of various AI platforms, which have amassed millions of users internationally, underscores the urgent need for such safety frameworks.