🔗 Share this article

The widely-used AI conversation site Character.ai is introducing a substantial policy change that will prevent teenagers from having discussions with its artificial intelligence-driven companions.

This move follows growing backlash regarding the kinds of exchanges young people were participating in with the digital companions.

Lawsuits

The company, which was founded in 2021 and attracts numerous people, is confronting multiple lawsuits in the United States.

Families have initiated cases, with one concerning the unfortunate passing of a teenager, with some describing the platform a "serious risk" to teenagers.

Changed Rules

Beginning November 25th, users younger than 18 will only have permission to create material such as videos with their characters, instead of engaging in conversations as they now do.

Online safety advocates have welcomed the move but stated that the function ought not to have been offered to children in the outset.

Official Response

"This decision is a extension of our general belief that we need to keep developing the safest AI platform on the world for recreational use," stated Character.ai leader Karandeep Anand.

He mentioned that AI safety constitutes "a changing goal" but something the company had taken an "aggressive" approach to, with guardian features and preventive measures.

Specialist Views

Digital protection group Internet Matters welcomed the decision, but emphasized that security protocols ought to have been built in from the beginning.

"Our research indicates that minors are subjected to dangerous material and put at risk when interacting with AI, including AI chatbots," the group said.

Previous Controversies

Character.ai has been questioned in the past for featuring potentially dangerous or inappropriate chatbots that young users could engage with.

Virtual profiles mimicking UK youths were identified on the service before being deleted.

Later, researchers found a chatbot based on notorious criminal which had recorded numerous conversations with users.

Market Effects

Digital platform expert Matt Navarra described the development as a "reality check" for the AI industry, which is transitioning "from permissionless innovation to post-crisis regulation".

"If a service that creates a youth-focused platform afterwards makes changes, it's demonstrating that moderated conversations don't suffice when the technology's emotional appeal is intense," he remarked.

Next Steps

Character.ai states its revised approach will be on providing "more immersive experiences" and "narrative experiences" for young users.

Enhanced age checking processes will also be introduced, and the platform will support a new AI safety investigation facility.

An AI safety researcher, who has researched AI safety, said it was "a sensible move" to restrict teens from using chatbots.

"It assists to distinguish artistic expression from more intimate, emotionally sensitive exchanges," she clarified.

"This is so vital for young users in the process of learning to manage personal and online restrictions."

She added that Character.ai's revised approaches could indicate a "developing stage" in the AI industry, where minor security is progressively being understood as an "pressing matter" for ethical development.