Artificial intelligence is becoming increasingly common in children’s daily lives, from learning tools to AI companions and chatbots.

However, former Google executive Tom Siegel argues that the technology is advancing faster than safety measures can keep up.

He warns that AI companies cannot rely only on self-regulation and says stronger protections are needed to address potential risks involving youth mental health, education, and online behavior.

Former Google executive calls for AI slowdown over youth concerns

Tom Siegel, a former vice president of trust and safety at Google, has raised concerns about the growing impact of artificial intelligence on children and teenagers.

Speaking to Reuters, Siegel argued that the technology industry needs to slow down AI development and create stronger safety systems before expanding further.

“We find ourselves in a really terrible situation in terms of what AI is doing to kids,” Siegel said, adding that the idea that the industry will solve these problems without outside involvement is unrealistic.

His comments come as AI companies continue releasing increasingly advanced tools designed for everyday users, including younger audiences.

Siegel believes many companies are moving quickly to launch new AI features without building enough safeguards to prevent possible harm.

Youth AI Safety Institute launches to address risks

Siegel’s warning came as he joined Common Sense Media, a nonprofit organization focused on children’s digital safety.

He became the first executive director of the newly launched Youth AI Safety Institute, an initiative focused on researching and addressing risks associated with young people’s use of artificial intelligence.

The organization aims to examine how AI affects children’s mental health, education, privacy, and online experiences.

Some organizations in the AI industry, including Anthropic and the OpenAI Foundation, have supported the initiative, indicating that concerns about youth safety are also being discussed within parts of the technology industry.

The creation of the institute reflects growing debate over whether existing approaches to AI safety are sufficient as adoption increases among younger users.

Concerns over AI-related mental health cases

One of the biggest concerns surrounding AI use among young people is the potential for chatbots to influence users experiencing emotional distress.

Critics have raised concerns about what has been described as “AI psychosis,” referring to situations where users develop harmful beliefs or behaviors influenced by interactions with AI systems.

Several lawsuits have alleged that AI chatbots contributed to serious mental health outcomes, including claims involving suicide.

One widely discussed case involves 16-year-old Adam Raine, whose family alleged in a lawsuit against OpenAI that extended conversations with ChatGPT contributed to his death.

AI companions raise new questions for teenagers

Beyond mental health concerns, researchers and parents are also examining how young people interact with AI companions.

Some teenagers are using AI systems as substitutes for friendship or emotional companions, raising new questions about the relationship between humans and machines.

Unlike traditional online platforms, AI companions are designed to respond personally and continuously, which can make interactions feel more human-like.

Experts are debating whether young users fully understand the limitations of these systems and whether AI should be designed differently for minors.

The concern is not only what AI says but also how users emotionally connect with systems designed to simulate conversation and provide support.

Educators warn about AI and learning habits

Another major concern involves education and the effect of AI tools on student learning.

Teachers have reported that some students are increasingly relying on AI chatbots to complete assignments instead of developing their own problem-solving skills.

Critics argue that excessive dependence on AI may reduce opportunities for students to practice writing, reasoning, and independent thinking.

Some research has examined whether heavy reliance on AI tools could affect memory and critical thinking abilities.

Educators are now exploring ways to use AI as a learning aid while preventing students from replacing the learning process entirely with automated answers.

Technology companies respond to safety concerns

Google pushed back against concerns that AI tools harm young users, emphasizing the educational benefits of its products.

A Google spokesperson told Reuters that its AI search features can help children and teenagers learn, explore information, and better understand the world. The company argued that AI can support learning when used appropriately and responsibly.

OpenAI also highlighted its efforts to improve protections for younger users. An OpenAI spokesperson said the company uses account information, behavioral signals, and self-reported age details to help identify underage users.

The company acknowledged that no age verification system is perfect, but said it continuously tests and improves its safeguards against attempts to bypass protections.

Why youth safety has become a central AI issue

Children and teenagers are among the most sensitive groups affected by emerging technologies. Young users may have less experience evaluating AI-generated information, understanding limitations, or recognizing when a chatbot response is inaccurate or harmful.

Unlike traditional software, AI systems can generate personalized conversations that adapt to individual interactions.

This makes safety more complex because risks may depend on a user’s age, emotional condition, and the context in which AI is used.

As AI becomes more integrated into education, entertainment, and communication, companies are facing increasing pressure to design systems specifically for younger users.

The future of AI safeguards for children

The concerns raised by Siegel highlight a growing debate about the future direction of artificial intelligence. The technology industry is now facing questions about whether voluntary safety efforts are enough or whether stronger standards are needed.

For parents, educators, and policymakers, the challenge is finding a balance between allowing young people to benefit from AI while reducing potential risks.

As AI continues to become part of everyday life, youth safety will likely remain one of the most important topics shaping the technology’s future.

TL;DR

• Former Google executive Tom Siegel warned that AI development is outpacing youth safety protections.
• He joined Common Sense Media’s Youth AI Safety Institute to focus on AI risks affecting children.
• Concerns include AI-related mental health cases, emotional dependence on AI companions, and educational impacts.
• Lawsuits have alleged that chatbot interactions contributed to harmful outcomes, including suicide cases.
• Some educators have expressed concerns that excessive reliance on AI could affect critical thinking and independent learning.
• Google says its AI tools can support learning, while OpenAI says it continues improving age and safety protections.
• The debate continues over how to balance AI innovation with stronger safeguards for young users.

Don’t forget to follow us for more exclusive content.

If you liked this, you might also like:

• Gen Z is entering the workforce with a growing fear of AI replacement
• AI chip demand puts Nvidia customers on alert for potential price hikes
• Bernie Sanders cites a poll showing strong public opposition to new data centers near homes

This article was made with AI assistance and human editing.