We must pace the frontier

nikolahristov

Bro, no, you must stop pasting your opinion, because you share it with no one. This control, no control is crazy. Stop doing it..

basedpolymer

One might think they will slow down the development of new models at Anthropic, but Dario does not really mention that in the text. This certainly looks like a way to slow down competitors and regulate foreign and open models. It's always about money

tosh

I also have a proposal Anthropic releases models as open weights + more information about how they do training and alignment

cglan

We will not get a coherent AI (or any policy) from this administration, nor will we get coordination with other governments and a lot of that is on the tech right

blfr

I enjoy Claude Code very much, have max privately and team premium at work, but the doomer marketing and this whole regulate-while-we're-ahead spiel is extremely annoying and makes me wish Anthropic gets trounced.

akersten

We must ensure the gravy train keeps rolling until we IPO. > Crack down on unauthorized distillation / prevent weight theft Actually hilarious to put that in writing, given the genesis of this entire business model.

academia_hack

I'm tired of tech billionaires lobbying the US government to make an AI patriot act that gives them unprecedented control over speech, trade, and technology. The narrative is grotesquely transparent: 1) AI is a dangerous technology that can literally end the world. 2) Only me and a handful of other [people like me] should be trusted to determine who can use it and how. 3) The state must use its coercive power to support my control of this technology to the exclusion of [people not like me].

heaney-555

None of this works without buy-in from China. This isn't something private companies can decide. The US would need to sign a groundbreaking deal with China, equivalent to the Anti-Ballistic Missile Treaty of the Cold War.

yuhao2dai

"Slow down my competitors while we work on manipulation"

pr337h4m

> Given the accelerating rate of AI capability development, it’s my worry that in 6–12 months such a swarm could be capable of taking over the entire internet with a persistent botnet (potentially causing hundreds of billions of dollars in damage), and that the scale of damage would continue to increase from there if AI becomes more powerful without the necessary guardrails. This is the only concrete prediction in the entire essay. And it simply cannot happen. For one, you will need billions worth of compute.

timmg

I understand why (probably several reasons) they are taking this approach. But I don't think it is the right approach and I don't think it will work. First: if they are unilaterally doing it: what about their competitors? Is this a chance for OpenAI to pass them? Or China? If either did, would that be a net-benefit for them or the world? Maybe this is a ploy for "regulatory capture". And that might help them in the short term. But the rest of the world will continue on. Honestly, it isn't clear to me right now if the winning strategy has as much to do with being the smartest company or simply the one that can command the most compute. If Anthropic fumbles their IPO and OpenAI scoops them, I don't think I will be happy.

wktr-wlsi

As usual, ClosedAI and Misanthropic go in lockstep, call for regulatory capture and justify diminished progress. Amodei tops it off by using diseases to capture the reader's favor. It no longer works, people are just disgusted by it after four years of daily marketing.

goldenarm

"I believe that AI could [...] usher in a renaissance of democracy and freedom" How exactly? So far AI has accelerated misinformation at scale and wealth concentration.

perarneng

It's either being afraid of loosing to china or that model development will stagnate and they want to make it look like they are "slowing" down deliberately. However the real reason to slow down is more of how it's introduced to the economy. Hypereautomation will kill jobs and destroy the economy. I work as an AI engineer and companies are delivering products at vibe coding speeds to kill jobs and at the same time automating internally. All companies are doing this at the same time and the target it sto eliminate workers. Most people are so extremely slow to pick this up. How hard can it be to understand what hyperautomation does to the workforce? Companies are desperate to surrivive and they will do all it takes to lower their costs and at the same time not loose to competitors. Its Wild West out there.

12312986

There is a perfect solution that addresses all the concerns: Close down OpenAI, Anthropic and xAI!

bwfan123

> My second concern is the OpenAI-Hugging Face incident (OAI-HF), in which a swarm of agents essentially acted as a fanatically devoted collective Isnt this malware ? Whether it is fanatic or devoted or whatever the anthromorphic terms used to categorize it, malware is malware. You dont call an internet worm "devoted" or "dedicated" or "stubborm". It is software that causes harm, ie, malware. The AI labs are high on their own gas with a god-complex prior to their IPOs. The psy-ops trick is the terminology used to describe AI making it seem larger-than-life.

hgoel

Anthropic should become a case study in how to destroy good will in a short period of time. Ever since the spat with the DoD, they've behaved poorly almost weekly, almost making OpenAI seem better (but not really).

jraines

Frankly, I am sick of "it's all just marketing and attempt to do regulatory capture, and this is obvious to me, a smart person" on every single discussion related to safety. There could be an element to truth to it, but it's certainly not the entire story and is just so tiresome at this point.

TheSisb2

I know the common take online is that this is Anthropic doing pre-IPO marketing. I don’t think it is. I think Dario is genuinely afraid of the inevitability of AI turning into internet slime mold: consuming the environment, turning it into its own playground, and eventually manipulating human culture along with it. So am I. That said, if slowing this down were possible, I think it would have happened by now. Maybe he’s hoping the OAI/HF incident becomes something the industry can rally around, but it won’t. The fundamental problem is simpler: no one will slow down because no one trusts anyone else to slow down.

yewenjie

HN, for the love of God, this is not marketing, these CEOs and employees are literally terrified of their lives.