Sam Altman: 'I No Longer Think We're Gonna Be Able to Just Patch All the Bugs'

altcognito

"Too dangerous not to regulate!" Nobody should have general compute!

overtone1000

I think I can guess what his proposed solution will be.

pmlnr

"To stop our all powerful AI that will go rogue you need to buy our all powerful AI" This is the textbook definition of racketeering.

petterroea

I hope Sam altman reads HN comment sections

seydor

Regulate the bugs

petcat

If they actually think that this version of AI is that dangerous, then the real risk is that USA and China will work together on a joint "AI non-proliferation" agreement much the same way that nuclear weapons technology became restricted by those that already had it. This will lead to a de facto techno-colonization of the rest of the world just between themselves. We already saw Trump and Xi discussing this exact scenario last month during their summit.

jmcs

When is the blackwall going live?

nradov

Maybe instead of patching all the bugs we'll instead leverage LLMs rewrite all the software from scratch with fewer exploitable vulnerabilities. That would have been a stupid idea a year ago but now it seems increasingly possible.

rasz

The strongest potions, you cant handle them.

bix6

> OpenAI is apparently getting into the arms dealer model of selling to both sides of a conflict. Business is booming!

cmiles8

What he really means is: Please regulate us, now! If we don’t get regulatory capture ASAP I’m toast. I mean look man I just had to go beg for tens of billions more cash so I can keep the lights on and my IPO is looking more and more screwed every day. Please, I’m begging you. What more do I need to say to convince you?

supriyo-biswas

The more likely thing is that we'll see people use the sandboxing and security tools that people already have. After all, it's quite easy to get LLMs to write a seccomp profile, a Kubernetes manifest, or a systemd unit with the minimum required privileges and permissions, and for insecure C code, we'd probably see mainstream use of Fil-C and similar.

firefoxd

With php2shell going mainstream, to the point that random friends who happen to know I'm a programmer, consult me to understand the extent of it, I think they succeeded with their doomerism message. When we find a bug, we patch it. When we find more bugs, we patch them as well. That's what happened here. Sam is telling us, "we found bugs, it's over" and the general public swallowed the frog. I mean, there is the bbc interview where they invited a cyber security expert who said he didn't know php existed before the the news broke out. The general public doesn't see that gaff.

preommr

Not even the singularity can fix php. But all jokes aside, we're entering a new era where there's a paradox of pro-AI people going AI is really good, but not that good... when it kind of is that good. We'll probably have ai monitors as a service, but the bulk of the safety should come from AI doing better job of reviewing tricky bugs since humans refuse to spend effort on writing more formal specifications.

j45

This could mean tough times for the cloud in some ways.

sailfast

Obligatory “We are all trying to find the one who did this!” Sam Altman is definitely not Oppenheimer. He is correct that everyone needs the models not just the offense that hacks their way into Mythos while the rest of us are left locked out and hoping for the best. But that statement is ALSO self-serving. Kinda wish he’d gone into investment banking.

j45

There likely will be no way to defend the increased rate of cybersecurity issues due to AI, without incorporating AI in the response. The new patching and security fixes might be perpetual hotfixes.

3ha654

Yeah, the staggering amount of CVEs in qmail and postfix can never be remedied. What a clown. Has he ever programmed seriously?

tptacek

Nothing we're seeing so far compares with the summer of 2003. It may soon! It may be much worse! But you can tell that a lot of people in the discourse did not practice in this field 20 years ago. We should be clear-eyed, but not yet be destabilized by what's happening.

mathgradthrow

AI is, apparently, very good at producing proofs. Formal verification of program properties was out of the reach of human labor, but may not be out of reach for 10 million instances of Claude. Software security will, by my estimate, just shift to this new paradigm.