Home > Pro > News

OpenAI has plans for an AI ‘kill switch’ after model goes rogue, as Nvidia announces Hugging Face acquisition

OpenAI is reportedly putting more secure measures in place
Last Updated on
OpenAI has plans for an AI ‘kill switch’ after model goes rogue, as Nvidia announces Hugging Face acquisition
PC Guide is reader-supported. When you buy through links on our site, we may earn an affiliate commission. Read More

OpenAI is reportedly taking extra measures to ensure its autonomous AI agents cannot strike again. Back in July, an OpenAI agent went rogue, escaping its controlled sandbox environment to launch a cyberattack on Hugging Face, a popular platform for AI and machine learning. Just yesterday, Nvidia revealed that it has agreed to acquire Hugging Face for $12,930,300,000, promising to scale the platform and strengthen its infrastructure.

According to a report from Reuters, OpenAI wrote to two House Democrats to confirm that it is developing “automated shutdown capabilities” for its AI systems, in a bid to prevent a similar outbreak from happening again. The OpenAI company letter was reportedly sent a few weeks after the incident took place.

OpenAI will pay more attention to its autonomous agents

Lawmakers in the United States had sent letters to OpenAI during August to query the company on its existing safeguards. OpenAI responded by saying it will more closely monitor the actions of its AI systems. Reportedly, the letter also suggests OpenAI has made it harder for AI models to access the internet in safety tests; the autonomous agent that hacked into Hugging Face evidently bypassed any measures that were previously in place.

Shortly after the incident, lawmakers also suggested a ‘kill switch’ for these AI models. OpenAI looks to have complied with its new “automated shutdown” capabilities, which really does just sound like a fancier way to say kill switch.

It didn’t take long after the hack for Nvidia to team up with a host of other tech companies to form the Open Secure AI Alliance, pledging to ensure open-source tools are available for “defenders everywhere” in the world of cybersecurity. As seen in the graph below, Nvidia is by far the biggest contributor of open models and data to Hugging Face.

The Open Secure AI Alliance started drafting SAFE cybersecurity guidelines this time last month, detailing core principles on topics such as confidential reporting, collaborative analysis, and structured reviews for AI models, safeguards, tools, etc.

Another interesting tidbit about the acquisition relates to the price ($12,930,300,000), which you may have figured looks oddly specific. The amount makes direct reference to the ‘Hugging Face’ emoji the platform is named after, which uses the Unicode U+1F917, which translates to 1F917 in hexadecimal and 129303 in decimal. As a secondary Easter Egg, some suggest the ’93’ relates to Nvidia, as the company was originally founded in 1993, though we’ll let you decide if that’s just a coincidence or not.


292
Which Acer Predator Atlas 8 handheld would you choose?

Acer announced UK pricing, but which one do you think is the best config/price?

About the Author

At PC Guide, Jack is mostly responsible for reporting on hardware deals. He also specializes in monitors, TVs, and headsets and can be found putting his findings together in a review or best-of guide.