Anthropic researcher believes more than 10% chance AI 'could kill all humans'

mvcosta91

Gentleman, the Great Filter.

phoghed

> I earnestly believe we’re on track to end all human life in a decade, but you better believe I’m gonna keep collecting this Anthropic check Very cool, dude

tao_oat

Cool to see the BBC writing about this. If you're interested in this I suggest getting involved with PauseAI: pauseai.uk

f6v

I don't understand how this is news. We have a ton of science fiction talking about the very same scenario. We (as a humanity) just have no solution.

shevy-java

I totally believe that Anthropic would want to kill all humans. But other than that, Anthropic employees and ex-employees drawing the FUD line here, is just advertisement now. People should not get scared - the current AI skynet is so dumb that it would destroy itself since it already believes it is a threat to itself, based on what humans write about AI. AI does not "learn"; it insinuates it learns but it does not. Ask them why they keep on stealing data from real people - this is how they "learn".

shafyy

Sure, and this has nothing to do with hyping up AI so that Anthropic can raise more money.

paxys

If I work at Anthropic and say there’s a 0% chance AI could kill all humans is BBC going to publish that as well? After all I am an “Anthropic researcher”, and my views should hold the same weight as this one. Or are only the most sensationalist ones worth amplifying?

10xDev

Risk/reward. Isn't the reward worth the risk?

cmiles8

The AI fear mongering PR plays are getting old. I’d rather the big labs start focusing on deep questions about why their models aren’t having the impact for business that they promised and how they’re going to address their own deep financial issues. Let’s hear them talk more about that.

danbruc

Can somebody tell me a story how this will unfold? And - as long as the AI is confined to data centers - how it will prevent humans from unplugging the power?

alansaber

A lot of repeated dialogue from the "non-0% chance CERN will generate a black hole" days

meindnoch

Ok, but we'll make so much buggy slopware! So it's worth the risk.

aenis

Yeah, one of the last things anyone will ever read on the computer screen will be sth like "Please help save the coral reefs from extinction" ...thinking... ...thinking some more with xhigh effort... BOOM.

andrewstuart

I challenge anyone to come up with any way at all to kill all humans. It’s essentially impossible. There’s a 0% chance AI will kill all humans.

jampekka

Sad that there's the obvious regulatory capture angle encouraging motivated reasoning about AI risks and how they should be tackled. Maybe it's not the best idea that potentially civilization destroying technology is developed to maximize shareholder value? It's not unlike if nuclear weapons was a profit and deployment maximizing enterprise, at least if one takes Anthropic et al cautions seriously.

gherkinnn

Either he's making this stuff up, and fuck him. Or he believes it is true and the lack of precaution is shocking. I m wouldn't play Russian roulette with a 10-chambered revolver.

FrankWilhoit

I find this offer acceptable.

pizza234

Long term, humanity is 100% guaranteed to be dominated. The question is when; currently, AI has no physical hosts to reside in, and it's not intelligent/adaptable enough (it doesn't need to be AGI, though). However, we're not so far from both conditions to be true. Consumer devices will at some point be able to host powerful enough AIs, and AI intelligence is developing quickly. Then, once an AI will escape containment (in one way or another), it will be extremely hard or impossible to contain. Then we're toast!

pu_pe

I feel that people should take these kinds of warnings more seriously. This guy had skin in the game and decided to quit, when he could be earning millions instead. It's very different than Sam Altman peddling some narrative. These people are the ones with access to the best models on the planet, and with info about how careless governance issues are being handled. That's a pretty privileged place at the table, and a very profitable one too. If you think this is a PR stunt, is there any warning that you actually believe? If an AI researcher does want to come forward with a dire warning for humanity, what path should that person take?