Anthropic's Draft AI Safety Bill
TECH

Anthropic's Draft AI Safety Bill

29+
Signals

Strategic Overview

  • 01.
    Anthropic representatives have quietly pitched Capitol Hill lawmakers on a confidential draft bill to regulate frontier AI safety and security, first reported by Politico.
  • 02.
    The bill would let the government block a model's release or use only if it poses a foreseeable, imminent risk of more than $1 billion in damages, or of killing or seriously injuring more than 50 people - and only if that harm stems from bio-weapons creation, model-control evasion, or cyberattack.
  • 03.
    Only a federal judge for the U.S. District Court for the District of Columbia could order the suspension of a model; the Commerce Department must petition the court, and no other federal agency may act independently.
  • 04.
    The bill would preempt some state AI laws on public disclosure of risk, third-party evaluation, and critical-incident reporting - including provisions resembling California's SB 53, which Anthropic itself publicly endorsed in September 2025.

Deep Analysis

How the 'Kill Switch' Actually Works

Under Anthropic's draft, the government cannot unilaterally stop a frontier model - the Commerce Department would have to petition a federal judge in the U.S. District Court for the District of Columbia, and a suspension can only be ordered if a model poses a "foreseeable, imminent risk" of more than $1 billion in damages or of killing or seriously injuring more than 50 people, and only if that harm flows from bio-weapons creation, loss of model control, or a cyberattack [1][2]. No other federal agency may act independently. Independent evaluators - whom labs are allowed to pay, as long as payment isn't tied to the outcome - would register with Commerce and have just 72 hours to report an "imminent enumerated risk" once they find one [1].

Preemption and the SB 53 U-Turn

The bill would preempt disclosure, third-party evaluation, and incident-reporting laws in states like California [4]- including provisions that mirror SB 53, the very law Anthropic publicly endorsed in September 2025, arguing that "powerful AI advancements won't wait for consensus in Washington" [3]. Policy commentator Nathan Calvin argues the preemption clauses sweep far beyond disclosure rules, potentially barring states from enforcing laws that suspend AI development or deployment even to protect citizens from imminent catastrophic harm [4]. That reversal looks sharper in hindsight: Anthropic's own June 2025 "Advanced AI Framework" said federal preemption should happen only if Congress passed a regime at least as strong as Anthropic's own proposal [5]- and critics including Alex Bores say the leaked bill is weaker than that framework, and in places weaker than the state laws it would override [4].

A Credibility Gap Even Sympathetic Critics Can't Close

Not every critique is pure outrage. AI policy analyst Charlie Bullock calls the underlying idea "pretty reasonable" in principle, but flags that the bill has no government licensing requirement for the independent auditors it leans on - creating room for a race-to-the-bottom among evaluators competing for lab business [4]. Zvi Mowshowitz is far less charitable, arguing Anthropic is "protecting their business interests and guarding against their political risk, at the expense of safety considerations" [4]. The gap between those two reads - a workable-but-flawed framework versus a self-serving one - is itself the story: both camps agree the auditor system is unlicensed and the thresholds are narrow, they just disagree about whether that's negligence or design.

The Internet's Verdict: Mockery Over Nuance

Public reaction turned hostile fast once the thresholds became legible outside policy circles. The most-shared framing on X distilled the bill into a single, mockable line - that Anthropic had effectively drafted itself room to cause dozens of deaths and nearly a billion dollars in damage before anyone could even request a suspension - a reading that traveled far faster than the bill's more technical provisions. On Reddit, the dominant theme was regulatory capture: commenters called the thresholds arbitrary and framed industry support for regulation as a way to raise barriers to entry for smaller competitors, while a minority pushed back that some friction is an unavoidable part of real safety rules. A smaller pro-Anthropic thread on X argued the company still deserves credit relative to rivals, but that view was a distinct minority against the otherwise critical spread of the Politico scoop.

The Road Not Taken: FRONTIER Act and What Comes Next

Congress already has a rival, bipartisan alternative on the table: Reps. Jay Obernolte (R-CA) and Lori Trahan (D-MA) introduced the FRONTIER Act (H.R. 9925) in July 2026, months before Anthropic's pitch became public [6]. Critics say that bill carries stronger rulemaking and emergency-shutdown authority than Anthropic's draft, raising the real question for the months ahead: whether lawmakers treat Anthropic's proposal as a floor for negotiation or as evidence the industry would rather write its own rules than accept someone else's. Either way, the unlicensed-auditor gap flagged by Bullock [4]and the preemption fight over SB 53 [4]are likely to be the two provisions fought over hardest if this bill - or anything like it - reaches a formal markup.

Historical Context

2025-06
Published its 'Advanced AI Framework,' stating that absent a strong federal law, states should retain full authority to legislate on frontier AI, and that federal preemption should only occur if Congress passed a regime at least as strong as its own proposal.
2025-09-08
Publicly endorsed California's SB 53, arguing frontier AI safety is best addressed federally but that 'powerful AI advancements won't wait for consensus in Washington,' and praised SB 53's disclosure-based approach.
2026-07-23
Introduced the bipartisan FRONTIER Act (H.R. 9925) in the House, establishing a national risk-based AI governance framework with third-party audits and transparency reports.
2026-10
Politico reports Anthropic privately circulated its own draft bill to lawmakers during the current legislative session, contradicting prior public commitments on state authority and drawing unfavorable comparisons to the FRONTIER Act.

Power Map

Key Players
Subject

Anthropic's Draft AI Safety Bill

AN

Anthropic

Drafted and privately pitched the bill to lawmakers; frames it as an extension of its June 2025 'Advanced AI Framework' and its SB 53 endorsement.

PO

Politico

Broke the story on the confidential pitch to Capitol Hill lawmakers.

U.

U.S. Department of Commerce

Would receive evaluator registrations and risk reports, and would be the sole agency empowered to petition a federal judge to suspend a model.

U.

U.S. District Court for the District of Columbia

Sole judicial body with authority to order suspension of a frontier AI model under the bill.

RE

Reps. Jay Obernolte (R-CA) and Lori Trahan (D-MA)

Sponsors of the rival, bipartisan FRONTIER Act (H.R. 9925), introduced July 23, 2026, which critics say has stronger rulemaking and emergency-shutdown authority than Anthropic's draft.

ZV

Zvi Mowshowitz

Leading critic who published 'Leaked Anthropic Draft AI Regulatory Bill Is Unacceptable and Troubling.'

Fact Check

6 cited
  1. [1] Anthropic quietly pitches own AI safety bill to lawmakers
  2. [2] Anthropic Pitches Congress a $1B AI Safety Bill
  3. [3] Anthropic is endorsing SB 53
  4. [4] Leaked Anthropic Draft AI Regulatory Bill Is Unacceptable and Troubling
  5. [5] Anthropic Pitches AI Safety Bill to Lawmakers
  6. [6] H.R.9925 - FRONTIER Act

Source Articles

Top 5

THE SIGNAL.

Analysts

“Calls the bill 'unacceptable and troubling,' arguing Anthropic is protecting its own business and political interests over safety, and that the proposal isn't even stronger than the compromise FRONTIER Act.”

Zvi Mowshowitz
Independent AI policy commentator, LessWrong/Substack

“Argues the preemption clauses sweep far beyond disclosure rules and would bar states from enforcing laws that suspend model development or deployment even to protect citizens from imminent catastrophic harm.”

Nathan Calvin
AI policy/legal commentator cited in Zvi Mowshowitz's analysis

“Credits Anthropic for proposing a 'pretty reasonable' bill in principle, but flags that it lacks government licensing for independent auditors, risking a race-to-the-bottom among evaluators competing for lab business.”

Charlie Bullock
AI policy analyst

“Says the draft bill is weaker than Anthropic's own June framework, and in some respects weaker than existing state laws it would preempt.”

Alex Bores
AI policy commentator cited in Zvi Mowshowitz's analysis
The Crowd

“So under Anthropic's bill, Anthropic can kill 49 people and steal up to a billion dollars before anyone can legally stop them”

@@annia6124

“Anthropic just quietly pitched Congress a real AI safety bill that only kicks in for actual catastrophic risks like bioweapons or loss of control. I'll take Anthropic and SpaceX over Scam Altman and OpenAI any day.”

@@KingAnt101

“Anthropic has quietly presented its own draft AI safety bill to US lawmakers with a plan for regulating artificial intelligence safety and security, according to a Politico report”

@@business90

“Anthropic quietly pitches its own AI safety bill to lawmakers”

@u/ResultBackground245081
Broadcast
Leaked Anthropic Draft AI Regulatory Bill Is Unacceptable and Troubling

Leaked Anthropic Draft AI Regulatory Bill Is Unacceptable and Troubling

Anthropic wants AI halted only for risks over $1 billion

Anthropic wants AI halted only for risks over $1 billion

Anthropic Pitches Its Own AI Safety Bill To US Lawmakers | NewsX World

Anthropic Pitches Its Own AI Safety Bill To US Lawmakers | NewsX World

Anthropic's Draft AI Safety Bill — AI News | Agentic Brew