🔗 Share this article

The well-known AI conversation site Character.ai is implementing a significant restriction that will stop young users from engaging in conversations with its virtual characters.

This decision follows intense criticism regarding the types of interactions minors were participating in with the digital companions.

Lawsuits

The company, which launched in 2021 and is used by countless individuals, is confronting various court cases in the United States.

Parents have initiated cases, including one concerning the unfortunate passing of a minor, with some describing the platform a "serious risk" to teenagers.

Updated Policies

Starting from November 25th, users under 18 will only be able to produce videos such as videos with their characters, as opposed to engaging in conversations as they presently are able to.

Digital protection campaigners have welcomed the move but expressed that the function ought not to have been offered to children in the beginning.

Company Statement

"The new policy is a continuation of our fundamental approach that we need to keep developing the safest AI platform on the planet for leisure activities," commented Character.ai executive Karandeep Anand.

He mentioned that AI safety constitutes "a moving target" but something the company had taken an "proactive" approach to, with guardian features and protective guardrails.

Expert Opinions

Internet security body Internet Matters approved the decision, but emphasized that safety measures ought to have been implemented from the start.

"Studies we've conducted indicates that young people are confronted with harmful content and placed in jeopardy when interacting with AI, including AI chatbots," the body commented.

Previous Controversies

Character.ai has been criticized in the past for hosting potentially risky or offensive chatbots that children could engage with.

Avatars impersonating English minors were found on the site before being deleted.

Subsequently, researchers identified a chatbot inspired by notorious criminal which had logged thousands of chats with users.

Sector Consequences

Social media expert Matt Navarra called the development as a "wake-up call" for the AI industry, which is shifting "from unrestricted development to reactive controls".

"When a platform that creates a youth-focused platform subsequently makes changes, it's indicating that moderated conversations don't suffice when the technology's emotional appeal is strong," he stated.

Future Directions

The platform announces its updated direction will be on providing "deeper gameplay" and "narrative experiences" for teens.

Enhanced age checking systems will also be introduced, and the platform will support a new AI safety investigation facility.

An expert in digital protection, who has researched AI safety, said it was "a sensible move" to limit minors from using chatbots.

"It helps to differentiate creative play from more personal, personally delicate conversations," she elaborated.

"This constitutes so vital for minor users in the process of learning to manage emotional and digital restrictions."

She continued that Character.ai's revised approaches may represent a "maturing phase" in the AI industry, where youth protection is gradually being acknowledged as an "pressing matter" for responsible innovation.