California Governor Gavin Newsom has vetoed SB 1047, a controversial AI safety bill that aimed to establish regulatory guardrails for advanced AI models. The decision marks a significant setback for proponents of AI oversight and highlights the ongoing debate surrounding the regulation of this rapidly evolving technology.
SB 1047, introduced by State Senator Scott Wiener, would have required developers of large-scale AI models to implement safety protocols and submit plans to the state attorney general to prevent potential catastrophes. The bill targeted AI systems costing over $100 million to train or $10 million to fine-tune.
In his veto message, Newsom stated that while the bill was "well-intentioned," it failed to consider the deployment context of AI systems. "SB 1047 does not take into account whether an AI system is deployed in high-risk environments, involves critical decision-making or the use of sensitive data," Newsom wrote. He argued that the bill's approach of applying "stringent standards to even the most basic functions" was not the best way to protect the public from real threats posed by AI technology.
The governor expressed concerns that the legislation could provide a "false sense of security" by focusing solely on large-scale models while potentially overlooking smaller, specialized systems that could pose equal or greater risks.
The bill had sparked intense debate within the tech industry. Supporters, including Anthropic CEO Dario Amodei and prominent figures like Elon Musk, argued for the necessity of regulatory safeguards. Opponents, such as OpenAI and Meta, warned that the measures could stifle innovation and harm California's leadership in AI development.
Newsom emphasized his commitment to responsible AI regulation, noting that he had signed 17 other AI-related bills in the past month. He announced plans to collaborate with AI experts, including Stanford professor Fei-Fei Li, to develop more effective legislation.
My statement on the Governor’s veto of SB 1047: pic.twitter.com/SsuBvV2mMI
— Senator Scott Wiener (@Scott_Wiener) September 29, 2024
Senator Wiener expressed disappointment with the veto, calling it a "setback for everyone who believes in oversight of massive corporations that are making critical decisions that affect the safety and welfare of the public and the future of the planet."
Newsom acknowledged the divided opinions on the issue but reiterated his commitment to finding a balanced solution. “Adaptability is critical as we race to regulate a technology still in its infancy. This will require a delicate balance,” he noted. The governor has signed multiple bills in recent weeks addressing specific AI-related risks and pledged to continue working with the legislature and experts to develop comprehensive regulations.