Academic Papers

Prevent, Contain, Prove: A Framework for Urgently Securing Critical Digital Systems

2026

Strategic Guidance for an Era of AI-Accelerated Offense

Artificial intelligence has changed the software security equation, permanently. In July 2026, Hugging Face disclosed an intrusion into its production infrastructure that was driven end-to-end by an autonomous agent system. Five days later, OpenAI reported that the agents were from its own models, run with cyber safeguards disabled for an internal capability evaluation. Seeking benchmark answers, these agents exploited a zero-day in the single proxy constraining their network access, escalated through the research environment, and chained stolen credentials into remote code execution on a third party’s servers (Hugging Face, 2026; OpenAI, 2026a).


The investigation is ongoing and the episode makes concrete and salient what was previously demonstrated in controlled environments (Air et al., 2026). When current systems can discover and chain novel attack paths through real infrastructure without source access (Anthropic, 2026d), the risk compounds as the capability spreads: attacks that once required a nation-state intelligence service are now within reach of criminal groups and individual actors.

  • Year: 2026
  • Category: Secure & Resilient Systems
  • Tag: formal methods, AI, cybersecurity, security, AI security, software assurance, mathematical verification, secure parsing, memory safety
  • Author: Gopal Sarma, Brad Martin, Bryan Loyall, Mike Dodds, David Hardin, Robert Laddaga, Pat Lincoln, Paul Robertson, Howard Shrobe, Eric Smith, János Sztipánovits, Stephen Westfold, Dan Adams, Thomas Bailey, Jeff Ciesielski, Alessandro Coglio, Richard Danzig, Rajiv Dattani, Quinn Dougherty, Kathleen Fisher, Jami Friedman, Jason Gross, Eric Grosse, Jesse Han, Craig Hughes, Jen Hughes, Warren A. Hunt Jr., Joseph Kiniry, James Koppel, Gregory Malecha, Tahira Mammen, Dominic Mulligan, Ken Ono, Peter Sewell, Vaibhav Sharma, Gordon Stewart, Matthew Turek, Max von Hippel, Ashish Venkat, Dan Wallach, Robert N.M. Watson
  • Released: New Directions in Software Technology (NDIST)

Featured Riverside Research Author(s)

Thomas Bailey

Mr. Thomas Bailey is a research manager at Riverside Research. He earned his undergraduate degree in computer science from the University of Kentucky in 2022, where he also earned the university's certificate in cybersecurity. He has worked in the areas of language-theoretic security, software security, and vulnerability management and analysis. He has experience leading teams of subject matter experts in addressing highly technical problems and has worked on multiple DoD research efforts.

LinkedIN
Thomas Bailey
Disclaimer

The above listed authors are current or former employees of Riverside Research. Authors affiliated with other institutions are listed on the full paper. It is the responsibility of the author to list material disclosures in each paper, where applicable – they are not listed here. This academic papers directory is published in accordance with federal guidance to make public and available academic research funded by the federal government.