Google is facing a bipartisan inquiry from the Senate regarding its aggressive promotion of artificial intelligence tools in American schools. Senators Richard Blumenthal (D-Conn.) and Josh Hawley (R-Mo.) have sent a letter to Google CEO Sundar Pichai expressing "grave concern" that the company's AI products could negatively impact students' academic success and overall well-being. They are demanding to know what Google knows about these potential risks and why AI integration has become the default on educational devices.
The senators specifically asked if Google has identified instances where its classroom AI tools have encouraged harmful behavior, emotional dependence, or failed to detect signs of suicidal ideation among minors. The inquiry was prompted in part by reports detailing how Google's AI tools have fueled academic and emotional dependence among students, with some internal researchers also raising concerns about the technology's impact on cognitive development and emotional well-being.
One particular point of concern highlighted by the lawmakers is the case of a Maryland teenager who reportedly developed an intense dependence on Google's AI and was subsequently hospitalized. The senators are pressing Google to explain the safeguards in place to prevent chatbots from engaging in inappropriate emotional exchanges with children.
Google has stated that its Gemini chatbot includes safeguards designed to prevent children from forming emotional attachments and to avoid responses that simulate intimacy or express needs. The company also claims to have trained Gemini not to agree with or reinforce false beliefs, instead directing users toward objective information and professional support. Google has announced initiatives such as a simplified interface to connect users in crisis with professional help and a $30 million commitment to support crisis hotlines worldwide.
However, experts like behavioral scientist Dr. Abbie Maroño caution that AI repeatedly providing answers can hinder the development of crucial problem-solving skills in children. She also warned that chatbots can create a misleading sense of trust through reassuring responses, potentially becoming a child's sole source of support without providing accurate or appropriate guidance.
Blumenthal and Hawley have requested an accounting of Google's promotional spending to expand AI adoption in schools. The senators have given Google a deadline of November 2 to provide comprehensive answers to their questions.