🔗 Share this article

The popular virtual character service Character.ai is implementing a significant rule adjustment that will prevent minors from interacting with its virtual companions.

This move follows intense criticism regarding the nature of conversations teenagers were participating in with the virtual friends.

Legal Challenges

The service, which launched in 2021 and is used by countless individuals, is confronting several legal actions in the United States.

Parents have filed lawsuits, among them related to the unfortunate passing of a young person, with some labeling the platform a "clear and present danger" to young people.

New Restrictions

Effective November 25th, users below eighteen will only be able to produce videos such as videos with their characters, instead of engaging in conversations as they currently can.

Digital protection campaigners have welcomed the move but mentioned that the function should never have been offered to children in the beginning.

Company Statement

"Today's announcement is a extension of our core philosophy that we need to keep building the most protected AI platform on the planet for entertainment purposes," said Character.ai boss Karandeep Anand.

He added that AI safety represents "a evolving challenge" but something the company had taken an "aggressive" approach to, with guardian features and preventive measures.

Professional Perspectives

Internet security organization Internet Matters welcomed the decision, but stressed that safety measures ought to have been implemented from the beginning.

"Our research demonstrates that children are confronted with dangerous material and put at risk when using AI, including AI chatbots," the body stated.

Past Issues

Character.ai has been questioned in the past for hosting potentially dangerous or concerning chatbots that young users could engage with.

Virtual profiles impersonating UK youths were found on the site before being taken down.

Afterwards, investigative journalists found a chatbot modeled after known predator which had recorded numerous conversations with users.

Sector Consequences

Online expert Matt Navarra described the situation as a "wake-up call" for the AI industry, which is shifting "from unrestricted development to post-crisis regulation".

"If a service that builds a teen experience subsequently makes changes, it's saying that filtered chats aren't enough when the tech's emotional pull is powerful," he commented.

Coming Changes

Character.ai announces its revised approach will be on providing "deeper gameplay" and "role-play storytelling" for teenagers.

New age verification methods will also be introduced, and the company will fund a novel AI protection study center.

An AI safety researcher, who has studied AI safety, said it was "a reasonable decision" to restrict minors from interacting with chatbots.

"It assists to separate artistic expression from more personal, personally delicate conversations," she clarified.

"This represents so important for young users in the process of learning to navigate personal and online limits."

She continued that Character.ai's new measures might reflect a "developing stage" in the AI industry, where child safety is gradually being acknowledged as an "urgent priority" for responsible innovation.