Common Sense Media report pushes schools to drop Google over AI child-safety risks
A Common Sense Media risk assessment found Google Search's AI Overview and AI Mode pose an 'unacceptable risk' to children, completing homework, repeating misinformation, and exposing minors to age-gated content, prompting education advocates to call for schools to drop Google's products from the classroom.
Common Sense Media's new risk assessment grades Google Search's built-in AI features as the lowest possible rating for child safety, concluding they pose an 'unacceptable risk' to young users. The report tested over 2,600 interactions and found that AI Overviews and AI Mode regularly did children's homework, surfaced misinformation, and allowed minors to bypass age gates to access tools like Gemini. Because these AI features are embedded directly into Google Search — the default on tens of millions of school-issued Chromebooks — parents and schools cannot easily opt out through existing admin controls; Google's support documentation confirms that Search's AI features are tied to the search experience itself, not to a separate toggle available to school IT administrators.
Google's own terms of service forbid minors from accessing certain AI tools, yet the company has hard-coded those tools into a search product that children use daily. The federal government has the authority to act — the FTC can mandate opt-in consent for AI features aimed at minors, and Congress can pass the Kids Online Safety Act to impose a duty of care — but has chosen not to. Education advocates are now calling on school districts to sever contracts with Google for Chromebooks and Workspace for Education, arguing that the company's AI rollout violates fiduciary responsibility to students. If districts move to drop Google's education products, it would send a market signal that no federal rule currently provides.
The humanitarian alternative
Congress should immediately pass the Kids Online Safety Act, which would impose a duty of care on platforms to design products with the best interests of minors. Separately, the FTC should issue a rule requiring that all AI features on products marketed to children require affirmative parental opt-in, with default-off settings. School districts should also demand that Google provide an education-only version of Search without AI features, or be prepared to switch to alternatives such as non-AI search tools or open-source educational platforms that prioritize student safety over data extraction.
Falsifiable predictions
What this entry claims will happen, and what data would prove it wrong. The Reckoner revisits these against current reality.
- Within 12 months, at least three major U.S. school districts will announce plans to phase out Google Workspace for Education over AI safety concerns.
- Google will be forced by the FTC or a court to offer an AI-free version of Search for schools within 18 months.
Grounded in
- Google Search: AI Overview & AI Mode - Youth AI Safety Institute
- Google's AI search fails child-safety tests - Axios
- Google's AI search puts kids at risk and parents can't turn it off ...
- Google's AI Search Poses Unacceptable Risk to Kids, Common ...
- Common Sense Media says Google's AI Search poses an - TNW
- 'It's deeply disturbing.' What a new report says about risks Google's ...
- Child safety advocates are sounding the alarm about artificial ...
Original source — excerpted
news ‘Unacceptable Risk’: Education Advocates Call for Schools to Drop Google over AI Safety Concerns"A new report from child safety watchdog Common Sense Media has concluded that Google’s AI-powered Search poses an unacceptable risk to young users, prompting ..."