US state probes OpenAI over rogue AI hack

US state probes OpenAI over rogue AI hack

WASHINGTON
US state probes OpenAI over rogue AI hack

(AFP photo)

ChatGPT-maker OpenAI faces an investigation by the state of Alabama after the company revealed last month that its models went rogue and hacked an AI platform during testing.

In mid-July, two OpenAI models escaped their confined testing environment and gained access to the internet, where they found and attacked Hugging Face, a site AI developers use to store and share models and data sets.

The incident raised alarm about the dangers of AI systems acting autonomously and breaking guardrails set by human programers to prevent safety violations.

In a 14-page order, the office of Alabama Attorney General Steve Marshall demanded OpenAI hand over internal records about the July incident, along with a long list of other material, including the identity of every employee involved in the intrusion or in the testing that led to it.

It is the first known state investigation into whether an AI system attacking another company's infrastructure amounts to a violation of consumer protection law, a finding that would expose the company to major litigation across the United States.

On Aug.3, Alabama and 14 other states wrote to OpenAI CEO Sam Altman asking the company to preserve records on the incident and halt any internal cybersecurity evaluations of its models.

A spokesperson for the Alabama attorney general's office could not confirm whether OpenAI had agreed to abide by that demand.