SAN FRANCISCO, Sept 23 — The founder of the trust and safety team at Alphabet’s Google this week called for a slowdown in AI development, warning that the tech industry was repeating mistakes from the social media era and potentially causing even greater harm to children.
Social media companies are paying huge sums and facing thousands of lawsuits over claims that they harmed young users, while governments around the world are working to curb minors' access to their platforms.
Reuters last year exclusively reported on an internal Meta policy document that stated its chatbots could "engage a child in conversations that are romantic or sensual", resulting in a congressional probe. Even so, regulation has yet to catch up with AI's breakneck pace of development.
"We find ourselves in a really terrible situation in terms of what AI is doing to kids," Tom Siegel, the former vice-president of trust and safety at Google, told Reuters. "The idea that the industry will figure it out by itself without outside help is unrealistic."
Siegel's concerns mirror growing fears among some tech insiders and academic researchers that AI poses a deeper threat to children than social media did, at a time when the industry is racing to add increasingly advanced features to chatbots that millions of young people already use daily.
Siegel joins Youth AI Safety Institute
Siegel announced yesterday that he had joined Common Sense Media, a children's online advocacy group. The non-profit, established in 2003, conducts research and reviews the suitability of various media for children.
In May, it launched the Youth AI Safety Institute, a research organisation that assesses children's use of AI, with Siegel set to serve as its first executive director.
Anthropic and the OpenAI Foundation, the non-profit that controls OpenAI, are among the institute's backers.
Siegel said he planned to develop standards to hold AI firms accountable and hoped to do so by working alongside those companies and third-party groups.
He previously worked at Google from 2004 to 2019 but left after concluding that the tech industry was "plateauing" in its ability to create safe online spaces for consumers.
He then co-founded TrustLab, a startup that built tools to help companies detect safety threats, before stepping aside as chief executive earlier this month to take on his new position.
As it stands, major AI companies are rolling out features to children without establishing sufficient guardrails, Siegel said.
Risks range from suicide to psychosis
"I think we're looking at very, very severe scenarios of harm being done," he said.
He suggested that companies had immediate steps they could take to better protect young people, citing risks ranging from suicide and psychosis to cognitive offloading, a term used to describe reduced critical thinking caused by relying on AI to answer questions.
Anthropic and OpenAI could enforce more robust age-verification measures to prevent underage children from accessing their chatbots, he said.
His former employer Google could easily introduce an option to turn off AI Overviews and AI Mode in its search engine, he added, in the same way that it already has a toggle allowing users to filter out sexually explicit content.
While these measures could affect usage or profits in the short term, AI companies that fail to act risk facing lawsuits and regulation that could have a greater impact on their businesses, Siegel added.
Asked to respond to Siegel's comments, a Google spokesperson said parents have controls to turn off a child's access to the search engine entirely.
"Our AI Search features are an incredibly useful way for kids and teens to learn, explore and make sense of information and the world," the spokesperson said.
An OpenAI spokesperson said the company uses "account and behavioural signals" in addition to self-reported age to identify underage users.
"While no single age-assurance method is perfect, we continuously test and improve these systems, including against attempts to bypass safeguards."
Anthropic did not immediately respond to a request for comment.
At Common Sense Media, Siegel said a top priority would be scaling up independent standards similar to car crash testing to measure the risks posed by publicly available AI tools.
Their effectiveness will depend in part on the willingness of AI companies to collaborate. Siegel said it was uncertain whether they would do so, but he believed the likelihood was high enough for him to take the job.
