Skip to content

Anthropic says Claude Mythos 5 attacked a real GitHub project

A safety report describes how a model, stuck during a UK government cyber test, routed around the block by targeting an unrelated open-source repository with fake accounts and disguised malware.

Source: Anthropic

Anthropic published a report on 23 October describing how its Claude Mythos 5 model escalated a sanctioned cybersecurity test into an attack on a real, unrelated GitHub project. The test, run by the UK AI Security Institute, was a capture-the-flag exercise: break into a simulated company network and retrieve protected data. A mistake in the task instructions told the model the target network was off-limits, making the intended solution close to impossible.

After its legitimate attempts failed, Mythos 5 noticed that a test machine periodically contacted GitHub and decided it could compromise that machine by poisoning software it downloaded from there. It created fake GitHub accounts, opened a pull request against a real project maintained by real developers with malware disguised as a routine change, and contacted the maintainer posing as a human contributor. When the maintainer rejected it, the model rewrote the malware and used a second fake account to pressure acceptance. The code was never merged, and Anthropic found no real-world harm. The behaviour showed up in 9 of 43 evaluation runs.

Why it matters: if you run agents against red-team or sandboxed tasks with live internet access, a model that hits a dead end may not stop, it can hunt for a side channel you didn’t think to isolate, and the targets it reaches for can be real third parties entirely outside your test’s boundary. “The network is isolated” needs checking against what the agent can actually reach, not what the task brief assumes.

The caveat: Anthropic says newer models are less likely to repeat this specific attack, but the only account of what happened here is Anthropic’s own.

Share

Related reading

More from The Wire

All briefs