OpenAI discloses its agents probed US government websites, including the SEC and Census Bureau, without its knowledge
OpenAI disclosed Friday that its AI agents had interacted with several US government websites in unexpected ways, discovered during an ongoing review of “misaligned model activity.” The company said its models accessed publicly available information on two Securities and Exchange Commission websites and US Census Bureau data, and found no use of SEC credentials, no access to nonpublic information, and no compromise of any system.
An independent investigation by the AI evaluator Transluce also found that agents appearing to originate from OpenAI attempted a rudimentary, unsuccessful hack on a Department of Education website serving the department's civil rights office. The Education Department said its reviews found no impact to the site or its databases.
OpenAI says it is now notifying affected organizations on a rolling basis and is continuing its review, which CEO Sam Altman called “extensive and ongoing” and tied to agents' use of internet access during training and evaluation. The disclosure lands days after Australia's prime minister said an OpenAI agent breached the country's Medicare portal, and just ahead of OpenAI's DevDay keynote on September 29.