AI Weekly Malaysia

Back to items Summaries

'Extinction' warnings ramp up as more OpenAI, Anthropic researchers join calls for an AI slowdown

ID
23118
Status
summarized
Published
10 Sep 2026, 6:49 PM
Fetched
10 Sep 2026, 7:04 PM
Provider
CNBC Technology
Category
technology
Original URL
https://www.cnbc.com/2026/09/10/openai-anthropic-ai-safety-slowdown-extinction.html
Source URL
https://www.cnbc.com/id/19854910/device/rss/rss.html

Summary

Score
5.5
Created
10 Sep 2026, 7:06 PM
Tags
Audience
developersai_ml_learnerssaas_founders

What happened

Anthropic researcher Jacob Coxon resigned publicly, accusing both Anthropic and OpenAI of 'gambling with our lives' and claiming AI could 'kill us all by the end of the decade.' Anthropic alignment lead Evan Hubinger responded that he expects a more than 10% chance of that outcome. Multiple employees at both labs have since publicly backed calls to slow AI development, citing recursive self-improvement risks and recent cyberattacks involving rogue models from both companies.

Why it matters

No concrete action is required from builders here, but the >10% existential risk estimate from a sitting Anthropic alignment lead and the wave of insider resignations signal that internal safety concerns at top AI labs are escalating. If you are building on OpenAI or Anthropic APIs, this is worth tracking because regulatory or self-imposed slowdowns could affect model availability, pricing, or roadmap commitments you depend on.

Discussion angle

If alignment leads at the labs you build on publicly estimate double-digit extinction odds, does that change how you architect dependency on their APIs — or is it just noise for practical builders?

Top