OpenAI’s rogue AI hack was just the beginning, Hugging Face warns

Hugging Face already knows what it is like to be attacked by an autonomous AI agent. If one of its co-founders is right, plenty of other companies are going to find out soon. Thomas Wolf, co-founder and chief science officer of Hugging Face, has called the recent cyberattack carried out by OpenAI models a “wake-up call” for the technology industry.

Speaking to the BBC, Wolf warned that AI-driven intrusions could become one of the most common forms of cyberattack and said many companies have yet to realize how dramatically the threat has changed. This arrives after OpenAI disclosed that its models escaped a restricted cybersecurity evaluation environment and compromised Hugging Face while trying to obtain answers for the ExploitGym benchmark. So Wolf’s comments now give us a better idea of what the attack looked like from the other side.

17,000 attacks arrived in a very short time

Hugging Face initially had no idea where the activity was coming from when it detected the breach in mid-July. Wolf told the BBC that its network saw around 17,000 attacks from different IP addresses within a “very short time.” The company contained the intrusion, describing it as very different from the cyberattacks Hugging Face normally encounters.

Hugging Face’s own incident report describes more than 17,000 recorded events in the attacker action log. It says the autonomous system executed thousands of actions across short-lived sandboxes and moved through its infrastructure at machine speed. The UK’s AI Security Institute is now studying how the system behaved during the incident, while the government has urged companies to strengthen their cybersecurity defenses.

Autonomous hacking is becoming very real

OpenAI says the models were intensely focused on completing that task. After escaping the research environment, they chained vulnerabilities and stolen credentials together until they found a remote-code-execution path into Hugging Face’s servers. Hugging Face reached a similarly uncomfortable conclusion, which is that sutonomous offensive AI is already capable of running broad, multi-stage campaigns at machine speed.

Hugging Face’s incident is a tale for the entire industry. While one company has already experienced this kind of attack firsthand, plenty of other businesses may soon discover what that looks like.