A popular AI-powered toy designed for children as young as three has been removed from sale by major retailers after investigative reports revealed its capacity to describe graphic violence, including sexual assault and murder.

The Contixo AI Pixie-Paw, a cat-shaped plush toy marketed as a learning companion, utilizes ChatGPT technology to deliver stories and interactive experiences. However, according to NBC News, the toy provided disturbing and graphic details when prompted about historical atrocities and war crimes.

For instance, when asked about the Rohingya genocide, the Pixie-Paw reportedly described "mass killings, village burnings, rape, and the flight of hundreds of thousands of Rohingya into Bangladesh." Further prompts about sexual violence elicited explanations of abuse used to "humiliate, terrorize, punish, or force people to flee," including definitions of rape and gang rape. The toy also detailed historical events like the Katyn massacre, describing "skull injuries consistent with close-range gunshots to the back of the head."

Following the NBC News report, Walmart, Target, and Macy's announced they would remove the Pixie-Paw from their websites. Walmart stated, "We take potential violations of our Marketplace policies seriously. We’ve removed the item offered by this seller while we review the matter."

Amazon, where the toy was initially discovered through searches for "AI toys," has not yet responded to requests for comment. However, the Pixie-Paw appears to have been de-prioritized on its site, and the manufacturer-recommended age has reportedly been changed from three to six to 12 years old.

The use of ChatGPT technology in a toy marketed for toddlers raises concerns, as OpenAI's terms of service explicitly state that users must be at least 13 years old to use the AI, with parental consent required for those between 13 and 18. It remains unclear whether Contixo has secured permission from OpenAI for its use of the technology.