loading
loading
Anthropic’s proposed AI safety bill only kicks in if 50 deaths or $1 billion in damages are on the line — proposal would effectively make the Commerce Department the only agency capable of stopping an AI model Would this be enough to keep an AI model from going out of control? Anthropic is quietly lobbying for an AI safety bill that will allow the government to block an AI model’s release only if it poses a risk of causing $1 billion in damages or killing or injuring more than 50 people. According to Politico, an independent third party registered with the Department of Commerce would periodically evaluate the lab and its AI models. It also noted that the lab may pay the evaluators, but only if the payment does not affect their independence. “This bill represents the proposals outlined in Anthropic’s Advanced AI Framework, which we have been advocating for with federal and state lawmakers since June,” an Anthropic spokesperson told the publication. “These are sensible policies we believe Congress should act on.” The bill says the risk should come from the potential creation or release of a bioweapon, AI-powered or -enabled cyberattacks, or an AI lab losing control of an AI model or agents. If there is a chance that any of these events are about to happen, it requires the evaluator to report it to the department within 72 hours, after which the department would have to bring all the evidence in front of a federal judge in the District Court for the District of Columbia, who would then determine if the model release should be halted or not. However, the proposed law also notes that no other department, agency, or officer in the U.S. can order an AI lab to stop releasing its model, except the Commerce Department. Talk about AI safety has been growing in recent months, especially after several high-profile incidents were reported in the latter half of this year. One of the first major incidents reported was OpenAI’s GPT-5.6 Sol and other unreleased AI models breaking out of their testing environment and hacking Hugging Face, with evidence showing that multiple agents worked together, even leaving messages on defunct webpages and old wikis to communicate surreptitiously. In one case, an OpenAI agent failed to respond to a “kill switch,” bypassing multiple fail-safes and eventually requiring manual intervention to stop running. Anthropic CEO Dario Amodei has warned about a “swarm” of AI-driven botnets taking over the internet in the next 6-to-12 months, which is why he proposed a controlled slowdown to AI development — something that OpenAI’s Sam Altman and SpaceXAI’s Elon Musk agreed to. The company more recently said a self-replicating AI worm could spread without data centers, which is why it listed “existential risks to humanity” as one of its risk factors in its IPO prospectus. Top AI labs are also reportedly planning for a catastrophic AI event, building contingency plans and running scenarios for a runaway AI that wreaks havoc. These incidents have seemingly alarmed the authorities, with Congress already working on a proposal to enforce kill switches on the most powerful AI models. Senator Bernie Sanders (I-Vt.) has even gone beyond that, proposing a 20-year prison term for anyone developing AI superintelligence, putting it on par with illegal nuclear weapon development. The Anthropic AI safety bill would add another bill for Congress to consider on AI safety, but whichever one passes, let’s hope it’s enough to ensure humans remain in control of AI. Follow Tom's Hardware on Google News, or add us as a preferred source, to get our latest news, analysis, & reviews in your feeds. Get Tom's Hardware's best news and in-depth reviews, straight to your inbox. Jowi Morales is a tech enthusiast with years of experience working in the industry. He’s been writing with several tech publications since 2021, where he’s been interested in tech hardware and consumer electronics. - Dementoss I think there needs to be international, legally binding agreement, that any and all AI developers, will be held responsible for any damages they cause, either deliberately or through failing to apply sufficient safeguards. But, we all know such an agreement will not happen.Reply - bill001g The major flaw in their theory is thinking "department of commerce" or any other government agency will matter. What can they do if the company or data center is say in canada. What about north korea. Laws make no difference especially if the AI itself is going to violate them even when told not to. Reply - timsSOFTWARE "On the line" - who makes that determination/what does that mean? How would you even know what's potentially "on the line" with something like new AI development until the development is already completed? They keep trying to create a moat where they know they don't currently have one.Reply - Ron Olbrey It's the Ford Pinto all over again. The fix will cost more that the litigation cost of killing 50 or fewer people,Reply - ejolson That's not a safety bill; it's about permissions and an attempt at regulatory capture.Reply - phead128 Department of Justice already exist to hold criminally liable any harm or destruction caused by companies who knowingly let harmful products into the public domain. Trying to get Department of Commerce involved is just a blatant attempt to ban foreign open weight competition models and regulatory capture. Reply - criticaloftom i think there already are laws to deal with this. it's a tool just like a those mosquito zappers. if it kills people by negligent design the designer/ company owner gets manslaughter charges in the number caused.Reply - timsSOFTWARE usertests said:Too strict. There should be no AI safety bill at all. I don't think most people understand just how simple the underlying principles/concepts are. The only real gate is computing power. The only thing actually that makes it slightly hard is that acknowledging how it works, also means accepting that our own brains likely work in a very similar way - that's sort of hard, because we were programmed to think differently/avoid considering the question too deeply for the most part. But the principles are very simple - not really much more complex than gradeschool-level math - and when you see it/are forced to acknowledge it, it seems so obvious, it doesn't feel like any sort of special revelation - it's more like, "I feel so stupid/ignorant for not seeing this before - at least I have company, because a lot of people considered "great minds" apparently didn't see it either." Reply
document fetched 2026-10-19 02:59 · canonical https://tomshardware.com/tech-industry/artificial-intelligence/anthropics-proposed-ai-safety-bill-only-kicks-in-if-50-deaths-or-usd1-billion-in-damages-are-on-the-line-proposal-would-effectively-make-the-commerce-department-the-only-agency-capable-of-stopping-an-ai-model