California governor vetoes controversial AI safety bill

California Governor Gavin Newsom on Sunday vetoed a hotly contested artificial intelligence safety bill after the tech industry raised objections, saying it could drive AI companies from the state and hinder innovation.

Newsom said the bill “does not take into account whether an AI system is deployed in high-risk environments, involves critical decision-making or the use of sensitive data” and would apply “stringent standards to even the most basic functions — so long as a large system deploys it.”

Newsom said he had asked leading experts on generative AI to help California “develop workable guardrails” that focus “on developing an empirical, science-based trajectory analysis.” He also ordered state agencies to expand their assessment of the risks from potential catastrophic events tied to AI use.

Generative AI – which can create text, photos and videos in response to open-ended prompts – has spurred excitement as well as fears it could make some jobs obsolete, upend elections and potentially overpower humans and have catastrophic effects.

The bill’s author, Democratic State Senator Scott Wiener, said legislation was necessary to protect the public before advances in AI become either unwieldy or uncontrollable. The AI industry is growing fast in California and some leaders questioned the future of these companies in the state if the bill became law.

Wiener said Sunday the veto makes California less safe and means “companies aiming to create an extremely powerful technology face no binding restrictions.” He added “voluntary commitments from industry are not enforceable and rarely work out well for the public.”

“We cannot afford to wait for a major catastrophe to occur before taking action to protect the public,” Newsom said, but added he did not agree “we must settle for a solution that is not informed by an empirical trajectory analysis of AI systems and capabilities.”

Newsom said he will work with the legislature on AI legislation during its next session. It comes as legislation in U.S. Congress to set safeguards has stalled and the Biden administration is advancing regulatory AI oversight proposals.

Newsom said “a California-only approach may well be warranted – especially absent federal action by Congress.”

Chamber of Progress, a tech industry coalition, praised Newsom’s veto saying “the California tech economy has always thrived on competition and openness.”

Among other things, the measure would have mandated safety testing for many of the most advanced AI models that cost more than $100 million to develop or those that require a defined amount of computing power. Developers of AI software operating in the state would have also needed to outline methods for turning off the AI models, effectively a kill switch.

The bill would have established a state entity to oversee the development of so-called “Frontier Models” that exceed the capabilities present in the most advanced existing models.

The bill faced strong opposition from a wide range of groups. Alphabet’s Google, Microsoft-backed OpenAI and Meta Platforms, all of which are developing generative AI models, had expressed their concerns about the proposal.

Some Democrats in U.S. Congress, including Representative Nancy Pelosi, also opposed it. Proponents included Tesla CEO Elon Musk, who also runs an AI firm called xAI. Amazon-backed Anthropic said the benefits to the bill likely outweigh the costs, though it added there were still some aspects that seem concerning or ambiguous.

Newsom separately signed legislation requiring the state to assess potential threats posed by Generative AI to California’s critical infrastructure.

The state is analyzing energy infrastructure risks and previously convened power sector providers and will undertake the same risk assessment with water infrastructure providers in the coming year and later the communications sector, Newsom said.

—David Shepardson, Reuters

https://www.fastcompany.com/91200414/california-governor-vetoes-ai-safety-bill?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

созданный 10mo | 1 окт. 2024 г., 16:10:05


Войдите, чтобы добавить комментарий

Другие сообщения в этой группе

Time anxiety is ruining your life. It doesn’t have to

Chris Guillebeau spent years racing against time, visiting all 193 countries before he turned 35, hosting annual gatherings of thousands, and writing bestsellers like The $100 Startup. Bu

24 июл. 2025 г., 13:40:04 | Fast company - tech
This free site is like Google Maps for local food discovery

As my family settles into a whole new city and community, I’ve been eagerly exploring a variety of sites and services for discovering new gems and getting to know our area. And while our recent cr

24 июл. 2025 г., 11:20:08 | Fast company - tech
He helped kids be creative. Now, he wants to do the same for CEOs

More than a decade ago, Pramod Sharma set out to make learning more engaging. Through

24 июл. 2025 г., 11:20:07 | Fast company - tech
This tool lets users send fake legal letters that look real—without a lawyer

If you can’t afford a lawyer, it turns out there’s nothing stopping you from sending a scary-looking letter that, at first glance, seems to come from one—and hoping the recipient doesn’t read the

24 июл. 2025 г., 09:10:03 | Fast company - tech
9 essential Perplexity AI search tips and tricks

All right, settle in, folks, because today we’re going to try to out-Google Google with the next generation of search: Perplexity.

So, what exactly is

24 июл. 2025 г., 06:40:07 | Fast company - tech
Tokenization is gaining ground in the crypto world. Here’s what to know

Tokenization has long been a buzzword for crypto enthusiasts, who have been arguing for years that blo

23 июл. 2025 г., 21:30:05 | Fast company - tech