NYC Council Proposes AI Regulations Including 'Kill Switches' and Whistleblower Rewards
Legislative package aims to address risks posed by artificial intelligence companies operating in the city.
New York City Council is advancing a series of legislative proposals targeting artificial intelligence companies that conduct business within the city limits. The proposed bills include mandates for "kill switches" in AI systems and incentives for whistleblowers.
A comprehensive council-wide hearing is scheduled for next month, where all 51 members will convene to deliberate on the potential dangers that AI technology presents to New Yorkers. Council Speaker Julie Menin stated that while New York City is emerging as a global hub for technology and AI, there is a corresponding responsibility to implement safeguards against unintended consequences.
Menin has sent letters to the chief executives of five prominent AI companies: Dario Amodei of Anthropic, Sam Altman of OpenAI, Sundar Pichai of Google, Elon Musk of SpaceX, and Mark Zuckerberg of Meta, requesting their attendance at the hearing on October 5.
These city-level initiatives follow Governor Kathy Hochul's recent announcement that New York State will require AI companies to register in a government portal starting in November. Companies will also be obligated to report critical safety incidents within 72 hours under the state's new regulations.
The council's proposed legislation mandates that AI companies must obtain third-party validation before marketing, selling, or deploying AI systems within the five boroughs. This would necessitate an independent expert review of the companies' internal safety assertions.
Furthermore, the proposed laws would require the implementation of "kill switches" for any AI tool utilized in the city. The council defines a kill switch as a "human override that can shut down the system." Non-compliance with these regulations could result in fines of $25,000 per offense.
A separate bill within the package aims to establish a "first-in-the-nation approach" to reward whistleblowers with financial incentives drawn from fines collected from companies found in violation. Menin noted the city's existing regulatory frameworks for various industries and highlighted the comparatively minimal oversight for AI companies based in New York.
A spokesperson for the council clarified that the proposed regulations are intended to apply to companies with offices in New York City and are enforceable by the city itself. The council's press release cited "growing concerns that advanced and frontier AI model development could pose potentially catastrophic risks" as the driving force behind the expedited legislative process, emphasizing the need for increased oversight.
The urgency surrounding AI regulation has been amplified by recent events, including the resignation of Anthropic researcher Jacob Coxon, who cited fears that rapid AI development could lead to catastrophic outcomes by the end of the decade.