OpenAI and Anthropic oversold AI security breaches

gustavus

> OpenAI and Anthropic oversold “rogue AI” hacks to pressure the feds into regulating the industry which would effectively lock out future competition, tech insiders told The Post. The only substantiative comment to address the claim in the title, and it is from a nebulous "Tech industry insider". The other comments are by guys that run various "AI" Startups. I don't buy a lot of the hype either but trying to present their claim as some revelation or news should have something to add. The entire article is "Some tech people say the agents just had a bad sandbox and proper controls would've prevented this. Politicians are introducing bills to 'ban AI research '." There saved you a click or a commanding your AI agent summarizing it.

sajithdilshan

This kinda have a point, if Chinese companies can distill US models and offer it at a competitive price, what prevents another US startup doing the same? OpenAI and Anthropic can actually influence the regulations to be a barrier for entry. Also regarding all the hacks, I always wonder why are they so boring, like agents posting to some wiki or using a bug in documentation to execute some code in a sandbox remote server, like if AI is so dangerous, how come they haven’t hacked into banks and stolen money or hacked into North Korean nuclear program and shut it down or any other major disruptive incident.

einpoklum

... like they oversell everything about their LLMs. To the tunes of hundreds of Billions of USD.

kentonv

This is reporting an opinion held by outside observers as if it is a leaked internal secret. It's a perfectly valid opinion but not any kind of secret.

ill-ion

Maybe they were hoping for some of that sweet sweet gov money. Maybe a bailout, who knows?