California Governor Gavin Newsom has vetoed a controversial artificial intelligence safety bill, citing concerns from the tech industry that it could drive AI companies out of the state and stifle innovation. He indicated that he sought input from experts on generative AI to develop effective regulations that focus on empirical, science-based trajectory analysis. In light of potential catastrophic events linked to AI use, Newsom has instructed state agencies to expand their assessment of the risks involved.
Generative AI, which has the capability to create text, photos, and videos in response to open-ended prompts, has raised both excitement and fears about its potential impact on jobs, elections, and human interaction. The bill’s author, Democratic State Senator Scott Wiener, argued that legislation was necessary to protect the public from the potential uncontrollable advancements in AI. However, leaders in the AI industry expressed concerns about the future of AI companies in California if the bill was to become law.
Wiener criticized Newsom’s veto, stating that the lack of binding restrictions on companies developing powerful technology poses risks to public safety. He emphasized that voluntary commitments from industry are not enforceable and may not fully protect the public. Newsom acknowledged the importance of taking action to protect the public from potential catastrophes but emphasized the need for empirical analysis of AI systems and capabilities in developing solutions.
Newsom announced plans to work with the legislature on AI legislation in the next session, as federal efforts in Congress to implement safeguards for AI have stalled. He suggested that a California-specific approach may be necessary in the absence of federal action. The tech industry coalition, Chamber of Progress, supported Newsom’s veto, highlighting the importance of competition and openness in the California tech economy.
The vetoed bill would have required safety testing for advanced AI models and the establishment of a state entity to oversee the development of “Frontier Models” that surpass existing capabilities. Opposition to the bill came from various groups, including tech giants like Alphabet’s Google, Microsoft-backed OpenAI, and Meta Platforms, all of which are involved in generative AI development. Both supporters and opponents of the bill raised concerns about its potential impact on innovation and public safety.
In addition to the AI safety bill, Newsom signed legislation mandating an assessment of potential threats posed by Generative AI to California’s critical infrastructure. The state is currently evaluating risks to energy infrastructure and plans to assess water infrastructure providers in the near future. The bill’s rejection, along with the ongoing efforts to evaluate and regulate AI technology, reflects the complex balance between promoting innovation and ensuring public safety in the rapidly evolving AI landscape.
