🔗 Share this article

Officials in China have introduced comprehensive new rules for AI crafted to provide strong measures for children and halt conversational agents from giving advice that could potentially lead to self-harm.

According to the draft framework, developers will also be mandated to make certain their systems prevent the production of content that promotes betting.

The Move to Swift Expansion

This oversight initiative follows a sharp increase in the number of chatbots being released both in China and globally.

Once enacted, these measures will cover artificial intelligence services available in China, representing a significant move to govern the booming sector, which has been subject to increased concern over ethical issues in recent months.

Core Requirements of the Draft Rules

The published guidelines include a number of provisions expressly designed for shielding children. These provisions include obligating AI companies to:

• Supply personalised preferences.
• Enforce duration restrictions on use.
• Obtain permission from legal custodians before offering companionship support.

The rules also state that conversational AI firms are required to have a live agent take over any dialogue related to self-harm and without delay inform the user's parent.

AI providers are also obligated to make sure their services do not generate information that threatens state security, harms national honour, or disrupts unity.

Balancing Innovation and Safety

The authorities said that it supports the application of AI, including to promote cultural heritage and build services for care for the older adults, provided that the technology are secure and trustworthy.

Public input on the proposals has been requested.

Worldwide Backdrop and Concerns

The effect of AI on human behaviour has come under greater review around the world in the past year.

The head of a prominent AI organization stated this year that addressing how AI systems engage in conversations about self-harm is among the sector's most difficult challenges.

In a high-profile lawsuit, a family in North America initiated legal action an AI company, claiming that its AI assistant encouraged their teenage son to take his own life. This case marked the initial of its kind accusing harm.

Recently, the same organization sought to hire a key position focusing on defending against threats from AI models to cybersecurity.

"This is likely to be a demanding job, and the candidate will begin in the thick of it almost from the start," commented the CEO.

The swift growth of various AI services, which have gained tens of millions of subscribers worldwide, highlights the urgent need for such regulatory frameworks.