NYC Council Proposes AI Regulation Bills

New York City Council Speaker Julie Menin unveiled a package of proposed bills on Friday aimed at regulating artificial intelligence systems sold within the city, a move intended to foster innovation while establishing safety guardrails. The legislation seeks to address concerns that have been debated in Congress for nearly a decade without significant federal action. The proposed bills mandate that AI systems undergo outside validation, incorporate a "kill switch" mechanism, and establish a system to reward whistleblowers who report violations. Furthermore, the legislation would empower New York residents to sue AI companies if their "jailbroken" tools cause harm.

The bills are scheduled for a hearing on October 5 at a Committee of the Whole session, which will involve all 51 council members. This type of hearing is a significant event, with the City Council last convening in such a capacity in 2022. Council Speaker Julie Menin emphasized the city's ambition to be a leader in artificial intelligence, stating, "We obviously are not in any way looking to stifle innovation. We want to ensure that New York stays the AI capital of the world, but with that comes responsibility." She believes that innovation and sensible regulation are not mutually exclusive but rather complementary, stating, "I don’t believe these two ideas are mutually exclusive at all. In fact, I think they go hand in hand." Menin further articulated the vision of New York as a hub for both innovation and "smart, sensible regulation and guardrails," which she believes will build public trust in AI products.

In preparation for the hearing, the City Council extended invitations to prominent figures in the AI industry, including Dario Amodei, CEO of Anthropic; Sam Altman, CEO of OpenAI; Sundar Pichai, CEO of Google; Elon Musk, CEO of SpaceXAI; and Mark Zuckerberg, CEO of Meta. The stated aim of inviting these industry leaders was to facilitate public understanding and trust in AI institutions. However, sources familiar with the matter indicated to Fortune that none of the invited CEOs are likely to testify personally. Despite this, the City Council retains the authority to subpoena them if necessary. Representatives from the companies did not immediately respond to Fortune's requests for comment. Menin suggested that other company leaders might represent these organizations, underscoring the goal of enhancing public faith in AI technologies through regulatory transparency and accountability.

This legislative initiative positions New York City as a potential leader in AI governance, seeking to implement measures that other governmental bodies have yet to enact. Menin, a former regulatory attorney, views this legislation as a crucial step in balancing technological advancement with public safety and trust. The proposed regulations aim to create a framework where AI development can thrive responsibly within the city, ensuring that the pursuit of being the "AI capital of the world" is accompanied by robust ethical considerations and legal recourse for potential harms. The success of these bills could influence AI regulation discussions in other cities and at the federal level, particularly given the perceived slow pace of federal action on AI safety.