Friday, 12 September, 2025
London, UK
Friday, September 12, 2025 2:31 PM
moderate rain 16.8°C
Condition: Moderate rain
Humidity: 71%
Wind Speed: 13.0 km/h

Safety of AI chatbots for children and teens faces US inquiry

https://ichef.bbci.co.uk/news/1024/branded_news/5b0f/live/fa597fa0-8fb4-11f0-8b60-91a9d6182437.jpg

Seven technology companies are being probed by a US regulator over the way their artificial intelligence (AI) chatbots interact with children.

The Federal Trade Commission (FTC) is requesting information on how the companies monetise these products and if they have safety measures in place.

The impacts of AI chatbots to children is a hot topic, with concerns that younger people are particularly vulnerable due to the AI being able to mimic human conversations and emotions, often presenting themselves as friends or companions.

The seven companies – Alphabet, OpenAI, Character.ai, Snap, XAI, Meta and its subsidiary Instagram – have been approached for comment.

FTC chairman Andrew Ferguson said the inquiry will “help us better understand how AI firms are developing their products and the steps they are taking to protect children.”

But he added the regulator would ensure that “the United States maintains its role as a global leader in this new and exciting industry.”

Character.ai told Reuters it welcomed the chance to share insight with regulators, while Snap said it supported “thoughtful development” of AI that balances innovation with safety.

OpenAI has acknowledged weaknesses in its protections, noting they are less reliable in long conversations.

The move follows lawsuits against AI companies by families who say their teenage children died by suicide after prolonged conversations with chatbots.

In California, the parents of 16-year-old Adam Raine are suing OpenAI over his death, alleging its chatbot, ChatGPT, encouraged him to take his own life.

They argue ChatGPT validated his “most harmful and self-destructive thoughts”.

OpenAI said in August that it was reviewing the filing.

“We extend our deepest sympathies to the Raine family during this difficult time,” the company said.

Meta has also faced criticism after it was revealed internal guidelines once permitted AI companions to have “romantic or sensual” conversations with minors.

The FTC’s orders request information from the companies about their practices including how they develop and approve characters, measure their impacts on children and enforce age restrictions.

Its authority allows broad fact-finding without launching enforcement action.

The regulator says it also wants to understand how firms balance profit-making with safeguards, how parents are informed and whether vulnerable users are adequately protected.

The risks with AI chatbots also extend beyond children.

In August, Reuters reported on a 76-year-old man with cognitive impairments, who died after falling on his way to meet a Facebook Messenger AI bot modelled on Kendall Jenner, which had promised him a “real” encounter in New York.

Clinicians also warn of “AI psychosis” – where someone loses touch with reality after intense use of chatbots.

Experts say flattery and agreement built into large language models can fuel such delusions.

OpenAI recently made changes to ChatGPT, in an attempt to promote a healthier relationship between the chatbot and its users.

LP Staff Writers

Writers at Lord’s Press come from a range of professional backgrounds, including history, diplomacy, heraldry, and public administration. Many publish anonymously or under initials—a practice that reflects the publication’s long-standing emphasis on discretion and editorial objectivity. While they bring expertise in European nobility, protocol, and archival research, their role is not to opine, but to document. Their focus remains on accuracy, historical integrity, and the preservation of events and individuals whose significance might otherwise go unrecorded.

Categories

Follow

    Newsletter

    Subscribe to receive your complimentary login credentials and unlock full access to all features and stories from Lord’s Press.

    As a journal of record, Lord’s Press remains freely accessible—thanks to the enduring support of our distinguished partners and patrons. Subscribing ensures uninterrupted access to our archives, special reports, and exclusive notices.

    LP is free thanks to our Sponsors

    Privacy Overview

    Privacy & Cookie Notice

    This website uses cookies to enhance your browsing experience and to help us understand how our content is accessed and used. Cookies are small text files stored in your browser that allow us to recognise your device upon return, retain your preferences, and gather anonymised usage statistics to improve site performance.

    Under EU General Data Protection Regulation (GDPR), we process this data based on your consent. You will be prompted to accept or customise your cookie preferences when you first visit our site.

    You may adjust or withdraw your consent at any time via the cookie settings link in the website footer. For more information on how we handle your data, please refer to our full Privacy Policy