Anthropic pitches AI safety bill that may block a model if 50+ people could be killed
- ID
- 37642
- Status
- summarized
- Published
- 21 Oct 2026, 7:01 AM
- Fetched
- 21 Oct 2026, 1:13 PM
- Provider
- TechCrunch
- Category
- technology
- Original URL
- https://techcrunch.com/2026/10/20/anthropic-pitches-ai-safety-bill-that-may-block-a-model-if-50-people-could-be-killed/
- Source URL
- https://techcrunch.com/feed/
Summary
- Score
- 5.5
- Created
- 21 Oct 2026, 1:13 PM
- Tags
- Audience
- ai_ml_learnersai_agent_userssaas_founders
What happened
Anthropic has been circulating a draft US bill, reported by Politico, that would allow a model’s release to be blocked when there is a foreseeable imminent risk of more than 50 deaths or over $1 billion in property damage from a biological weapon, the model evading its developer’s controls, or a cyberattack. Evaluations would come from independent evaluators registered with the US Commerce Department, and AI labs could pay them as long as payment is not contingent on the results. The 50-person and $1 billion thresholds mirror California’s recently passed SB 53.
Why it matters
For builders relying on US frontier models, the details to watch are release gating and Commerce-registered evaluators, not just the headline thresholds: if adopted, access to models judged high-risk could be delayed or conditioned, and vendor-paid evaluations could become a procurement or compliance question. It is still a draft, so do not re-architect now, but track whether these triggers or evaluator rules show up in vendor terms or US market requirements.
Discussion angle
Should AI labs be allowed to pay the independent evaluators who decide whether their models can ship, and what safeguard would make that credible?