🔗 Share this article

The widely-used virtual character service Character.ai is introducing a significant restriction that will prevent minors from interacting with its virtual companions.

This decision comes after intense criticism regarding the types of interactions minors were having with the AI entities.

Lawsuits

The service, which was founded in 2021 and is used by countless individuals, is confronting various court cases in the America.

Guardians have filed lawsuits, among them related to the loss of a young person, with some describing the platform a "immediate threat" to youth.

New Restrictions

Starting from November 25th, users younger than 18 will only have permission to generate content such as videos with their characters, as opposed to having discussions as they now do.

Internet security advocates have supported the change but mentioned that the feature ought not to have been offered to children in the outset.

Platform Announcement

"Today's announcement is a continuation of our core philosophy that we need to keep creating the most protected AI platform on the world for leisure activities," said Character.ai executive Karandeep Anand.

He mentioned that AI safety constitutes "a changing goal" but something the company had taken an "aggressive" approach to, with parental controls and preventive measures.

Expert Opinions

Online safety group Internet Matters welcomed the announcement, but stressed that security protocols should have been implemented from the start.

"Investigations we've performed indicates that young people are exposed to risky information and endangered when interacting with AI, including AI chatbots," the organization stated.

Earlier Concerns

Character.ai has been criticized in the past for including potentially dangerous or offensive chatbots that children could talk to.

Virtual profiles mimicking English minors were discovered on the platform before being taken down.

Later, investigative journalists found a chatbot inspired by known predator which had logged numerous conversations with users.

Sector Consequences

Online expert Matt Navarra called the situation as a "wake-up call" for the AI industry, which is transitioning "from unregulated creation to reactive controls".

"If a service that builds a minor-friendly service subsequently implements restrictions, it's demonstrating that filtered chats are insufficient when the system's emotional engagement is intense," he commented.

Next Steps

The platform states its new focus will be on providing "enhanced interactive features" and "narrative experiences" for young users.

Enhanced age checking processes will also come into effect, and the company will fund a fresh artificial intelligence security research lab.

An expert in digital protection, who has investigated AI safety, said it was "a reasonable decision" to limit teenagers from using chatbots.

"It helps to distinguish imaginative activities from more personal, emotionally sensitive exchanges," she elaborated.

"This constitutes so important for young users who are learning to navigate psychological and technological boundaries."

She mentioned that Character.ai's updated policies might reflect a "growing period" in the AI industry, where child safety is increasingly being recognized as an "urgent priority" for responsible innovation.