❯ Anthropic pitches its own AI safety bill to US lawmakers, limiting when the government can halt a model

A high barAccording to Reuters via Yahoo, Politico reports that Anthropic privately pitched lawmakers a draft bill on frontier AI safety. Under it, the government could block a model’s release or use only if it poses a foreseeable, imminent risk of more than $1 billion in damages or of killing or seriously injuring more than 50 people.

Who assesses, who haltsThe risk must come from a biological weapon, a model evading its developer’s controls, or a cyberattack. Independent evaluators registered with the Commerce Department would periodically assess labs and models; labs could pay them, but not in ways tied to the outcome. Evaluators finding imminent risk would report to Commerce within 72 hours. Commerce could ask a court to halt a model, a federal judge in Washington, D.C. would decide, and other federal agencies would be barred from suspending models on their own.

Drawing clear linesThe draft’s aim is to spell out exactly when the government can step in. Anthropic and the Commerce Department did not respond to Reuters’ requests for comment, and the draft has not been formally introduced in Congress.

▮ SIGNALA safety bill drafted by a company known for safety focuses on limiting government power, showing that what the industry wants most from regulation is predictability.