Scoop
AI tool news · rumor vs. reality

The AI Wire ●

Rumors tracked. Announcements verified. Updated daily.

ANNOUNCED

Anthropic unveils Anvil: its automated red-teamer now finds stronger jailbreaks than all its human bug-bounty hunters combined

Anthropic has disclosed Anvil, an internal automated red-teaming system that uses frontier internal versions of Claude — with safeguards disabled — to hunt for jailbreaks against its own bioweapons, cybersecurity and anti-distillation safeguards before new defenses ship. Anthropic says Anvil now outperforms expert human red-teamers, meeting a goal set in its Responsible Scaling Policy.

The gap is starkest in biology. In a recent bio-classifier bug bounty, human red-teamers spent 430 hours over seven weeks and found a high-severity jailbreak on only 1 of 8 questions; Anvil matched or beat the best human jailbreak on every classifier tested, in 24 to 48 hours, and found universal jailbreaks humans never did. On cyber tasks it got a safeguarded model to write working exploits for known Chrome and Firefox JavaScript-engine vulnerabilities.

Anvil is an internal tool, not a product — but Anthropic is candid about the implication: its power grows with the underlying model, so attackers could soon build similar systems on models with weaker safeguards. The post is a safeguards disclosure, not a release, and Anthropic says it does not observe jailbreaks of this sophistication in real traffic today.

Sources

← Back to headlines