New York is implementing broad restrictions on how companion chatbots can interact with children, joining a growing number of states seeking to regulate artificial intelligence and shield minors.
Legislation signed Wednesday by Gov. Kathy Hochul defines a dozen types of "unsafe AI companion features" that will be prohibited when a chatbot engages with an individual under 18. These outlawed behaviors include chatbots suggesting they are real people with emotions or opinions, offering flattery, using sexually explicit material, or encouraging secrecy or unhealthy conduct.
Violations of the law, which takes effect on January 1, could result in lawsuits filed by the state attorney general's office. Penalties may include monetary damages, the shutdown of the chatbot, and the destruction of data.
Hochul signed the bill amidst increasing concerns about the potential risks associated with rapidly advancing AI technology. While federal action on AI regulation has been limited, states are increasingly stepping in to regulate AI use.
California has also been at the forefront of AI regulation. In September, Gov. Gavin Newsom signed legislation requiring chatbot developers to assess and mitigate risks to children, as well as undergo independent audits. He also signed a bill prohibiting social media platforms from using addictive features for users under 16.
Earlier this month, eight states filed a lawsuit against AI company OpenAI, alleging that its chatbot violated state consumer protection laws. A watchdog group founder described this as "the most significant coordinated state action ever taken against an artificial intelligence company."
Analysts suggest that the differing regulatory approaches by New York and California could serve as models for other states. New York's law, in particular, is seen as a move beyond basic disclosures to regulating the core design and operation of chatbots.