AI Cyber Proliferation
The risk that AI-powered vulnerability discovery and exploitation capabilities spread beyond actors committed to using them safely, before defensive measures are in place.
The dynamic
As frontier models improve at coding and reasoning, their cybersecurity capabilities improve as a byproduct. AI vulnerability discovery is not a gated capability — it emerges from general model improvements. Once a model reaches sufficient coding ability, it can find and exploit software vulnerabilities autonomously. This means:
- Capability proliferation tracks model proliferation
- Open-weight models of sufficient capability will carry these skills
- The cost and expertise barrier to finding zero-days is dropping rapidly
Current state
Claude Mythos Preview represents a threshold: a model that surpasses all but the most skilled humans. Anthropic chose not to release it generally and instead channeled it into Project Glasswing. But the announcement itself signals that this capability class exists and will recur in future models from multiple developers.
Scale of the threat
The Glasswing announcement estimates global cybercrime costs at roughly $500B per year under current conditions. State-sponsored actors (China, Iran, North Korea, Russia) already target critical infrastructure. AI-augmented attacks could make these more frequent, more sophisticated, and accessible to less-skilled actors.
Mitigation approaches
- Temporal advantage: deploy defensive scanning before adversaries gain equivalent capabilities (defensive AI advantage)
- Access control: restrict the most capable models (Anthropic’s approach with Mythos Preview)
- Safeguard development: detect and block dangerous outputs before making Mythos-class models broadly available
- Coalition defense: coordinate scanning across the full attack surface (Project Glasswing)
- Government involvement: maintain democratic nations’ lead in AI technology; assess and mitigate national security risks
See also
- Defensive AI Advantage — the counter-strategy
- AI Vulnerability Discovery — the capability that proliferates
- Project Glasswing — the coalition response