Did Anthropic ask for this?

spwa4

Exactly the question I've been wondering. Anthropic has been behaving as if serving Fable is way too expensive. And now they got people's money, and don't have to serve anything. Convenient.

rvz

Yes. They got even more than what they asked for.

optimalsolver

Citizenship guarantees service.

CamperBob2

The Fable debacle will justify the imposition of a solid legislative framework to serve as a legal foundation for the entire business sector. A DMCA for AI, if you will. The other incumbent players will demand it, because they can't do business subject to the arbitrary (or worse) whims of Donald Trump or whoever follows him. That framework is, of course, what Amodei did ask for, but he mistakenly thought he'd have a seat at a table populated by rational actors. Even after the Trump administration explicitly told him otherwise when they declared his whole company to be a national security threat. So what happened is all Amodei's fault. It's possible that the Anthropic board will decide that this particular unforced error is his last one. In fact, given that Amazon is apparently the prime mover behind this whole train wreck, I'd almost bet on it.

bravetraveler

It's aggrandizing and spares compute, I'd have to assume so... if not done so publicly. Clearly was requested. A silly title proposition: 's/Anthropic/Dario/' ; he wrote the essay TFA discusses. No 'think' required, they're surprised at the shape. $ xdg-open fakerake.png Claude: regulate me USA: YOU ARE BEING REGULATED Claude: oh my god Might believe I'm overstating compute; consider, how often does OpenAI falter? Now, Anthropic before and after their recent capacity deals. We got to see the girlfriend that goes to another school, now she can go home [with cover from Uncle Sam, the trip is ~~expensive~~ dangerous] .

ivraatiems

Maybe this will be simpler for Anthropic to understand if they take their own high-minded philosophical nonsense and ego out of it and consider it the way a neutral party would. Suppose a company calls themselves The Doomsday Device Company. They make and sell excellent-quality doomsday devices. They regularly go online to proclaim that their doomsday devices are the best and most powerful, and also that doomsday devices are dangerous and should be regulated. The Doomsday Device Company then says they have the world's best doomsday device. (They don't, but they claim they do.) The US Government hates the Doosmday Device Company for various political reasons, but also has a vested interest in there not being a massive proliferation of doomsday devices. The Doosmday Device company spends a great deal of time and money telling everyone: "Our doomsday device is the most doomy of all time!" (though it probably isn't) and "Everyone can use it!" (for a lot of money) It is completely logical, then, for the US Government to say: No, everyone cannot use your doomsday device, because doomsday is bad. (While also meaning: Only we should be able to use it, and you shouldn't be able to tell us how.) If you do not want to be in the business of having your doomsday devices shut down by the government, well, it would help if you didn't so loudly and aggressively proclaim how doomy they are. It doesn't matter how trustworthy you claim to be, given that your business is making evil doosmday devices. You still won't be trusted!

colonCapitalDee

No, Anthropic clearly did not ask for this. 1. "Dario is known for writing about regulation and the direction of AI as an industry and Anthropic in particular, and what he says is taken very seriously and is considered a definitive statement of the company’s position." This is patently ridiculous. A CEO's blog post is not an official company statement or any sort of binding agreement. 2. "Are there protective measures against political favoritism or arbitrary decisions? I believe there are: they are called “courts”." This is so stupid. Of course Anthropic will take this to court (if it's not rescinded before then), and the government's ham-fisted "regulation" will almost certainly be overturned. And it doesn't matter! An unjust action that is overturned by the legal system does not magically become just. 3. "Is This Politically Motivated or Arbitrary? Probably at least somewhat." If the best you can muster here is "probably at least somewhat", then your head is in the sand. It clearly politically motivated, and clearly arbitrary. Perhaps a different government would receive the benefit of the doubt here, but not this one. 4. "“The government” or “society” is meant to deal with all of those things. Well, now the government is — the actual government that really exists, and not an imagined one that only does good things and never does bad things." So that's it? We just throw up our hands and say that this is natural, that it couldn't go any other way? That Anthropic was "asking for it", and it's their fault when the government lashes out? If the government wants to regulate AI, either Congress needs to pass a law, or the Executive needs to furnish a reasonable explanation for their actions. We do not live in a fascist country. There is separation between the government and private industry. The government does not have the power to arbitrarily regulate private enterprise. I am truly baffled by the inability for people to see this as it is -- a blatant, and foolish, attempt at posturing and political intimidation. It's part of a clear pattern of behavior by this administration, and should be interpreted as such.

ianm218

What I feel like is missing in the common discourse here is that Anthropic genuinely believes that AI poses an existential risk for humanity either in terms of literal survival or extreme mass surveillance, human disempowerment etc. So if you take these risks seriously, which the median commentor on HN obviously doesn't, what is the right thing to do? I.e. OpenAI just went full evil corpo mode and went all in on the Leading the Future PAC [1] to try and prevent any kind of regulation. I feel like there is a reasonable path where they might agree with OP that the government has "mostly gone insane" but also think that US getting its act together and leading the way on sane regulation will be key to getting to a good outcome with AI. [1]. https://en.wikipedia.org/wiki/Leading_the_Future

mitthrowaway2

I posted this comment on the other thread, but it deserves mention here too, because Anthropic also asked for this ~10 days ago, separately from the post linked in the article. https://www.anthropic.com/institute/recursive-self-improveme ... > We believe it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up with the advance of the technology. In their subsequent post this week responding to the announcement of the export ban, Anthropic wrote: > If this standard was applied across the industry, we believe it would essentially halt all new model deployments for all frontier model providers. Which is what they said would be good.

alaribi

> and there must be protective measures against political favoritism or arbitrary decisions. Didn't Anthropic say that the same jailbreak is possible with GPT 5.5? > I believe there are: they are called “courts”. Dario is as free as the rest of us are to file a lawsuit and go in front of a judge and tell the judge that he is the victim of political favoritism or an arbitrary decision. That is, in fact, one of the primary purposes of the legal system. This isn't realistic here. Yes, there's a system in place, but at the speed of these iterations/deployments, filing a lawsuit that will take months/years to resolve isn't a practical path forward.

TalkingCodeMonk

The premise here is rather ridiculous, and only entertainable if you don't know about the recent history of the admin declaring Anthropic a supply chain risk because they required the government to agree to ethical clauses that would've been considered unthinkable until recently. Remember, all AI companies openly claimed to oppose military usage just a few short years ago. Now they all have government contracts that allow the government to use them "lawfully", while also being able to decide that anything they do with them is lawful. Anthropic is the only one who required clauses against killbots and domestic mass surveillance. Anthropic never asked for arbitrary or opaque shutdowns. They asked for clearly defined regulations to apply equally (which would've helped their market position and advantage, coincidentally I'm sure /s), moreso to reduce their own risk and liability.

hmokiguess

When you are both the source of fear and hope people will always side with fear. If you sold everyone on the idea of "safety is paramount, we urge everyone not to rush into development here" then certainly becomes hard to believe a blanket "we figured out safety, come play with our toys for 10x cost" when stuff is less than a month apart in your news page.

jdw64

To speak my mind without filtering, Amodei looks pretty terrible in this situation. They've positioned their company as 'We're the serious AI company that understands safety, while others underestimate the risks.' That strategy itself is understandable. They're not like OpenAI, which carved out the pioneer position in LLMs, nor do they have a trustworthy brand like Google (Gemini isn't trustworthy, but still). So branding around 'responsibility' made sense. The problem is that they pushed that narrative with the Trump administration. Without considering that LLM strategies need to change depending on the political context, they just input the same prompt into a different context and got bad results. The Trump administration's stance emphasizes external enemies. I guess they didn't know what would happen if they started talking about military weapons in that environment. We East Asians know authoritarian regimes 'very' well. So I guess people from the US, a country with so much freedom that they naturally lie flat on the ground, just didn't understand the difference. If they had advocated for AI freedom and free expression, many people might have helped them, like in the PGP situation in cryptography. But instead, they got caught up in their own claims. If you emphasize how dangerous AI is under an administration like Trump's that stresses external enemies, of course the government will say, 'Then let us manage it.' And the moment Anthropic says, 'Why just us?' it just looks ridiculous. They're the ones who went on about how dangerous it is, and now they're acting victimized for being treated as a dangerous entity. To be even more honest, Amodei's style of communication sometimes looks like a morality superiority hustle. They speak in a tone of 'We're not just a money focused company, we care about humanity,' but isn't Anthropic still a company that takes investments, sells models, rides the cloud, and tries to win government contracts? So it ends up looking like they use regulatory discourse as a shield and marketing when it benefits them, but complain 'it's not fair' when it works against them. Personally, I think Anthropic needs to hire a Korean person as their marketing lead. We Koreans know very well how to behave under authoritarian governments. If you need a marketing person, feel free to contact me. I'll prepare my resume

ralph84

This was an opportunistic hit job by Amazon. After the SpaceX IPO, Amazon realized there was a good chance Anthropic's post-IPO market cap would exceed Amazon's. No doubt they are maneuvering behind the scenes for regulations that the big cloud vendors be the only authorized operators of LLMs for national security reasons.

peter422

Anybody who isn't at least treating this situation as possibly just an authoritarian government picking winners and losers is not paying attention to the political environment. Companies/countries/people are paying off the government in all sorts of various ways (crypto, gifts, bogus settlements, planes, inaugurations, ballrooms). The companies that pay off the government get big fat contracts and merger agreements, and the ones that don't get increased scrutiny, lawsuits and threats. OpenAI and SpaceX are friends of the administration, and Anthropic is (politically at least), not friends with the administration. Could this penalty be a rational and reasonable reaction to the new model? Perhaps. Or maybe it is just a made up excuse to do what the government wants to do, which is punish its political enemies. It wouldn't be the first, second, third or 10th time that has happened so far in this administration.

moezd

Chekhov's gun. If you keep pointing to it, someone will fire that gun until the game ends.

quatonion

Half of me wonders if it was all a live simulation/drill, to practice what happens if a much more serious event occurs, and a model needed to be quickly shut down. Under such conditions we would be looking at Amazon's actions through a much more benevolent lens. Not saying it has been, but it certainly crossed my mind as something worth doing regardless.

theturtletalks

I haven’t used Claude in more than a year and didn’t even try Fable. As someone that doesn’t have a dog in this race, I feel like anthropic has been very consistent with their moral stance. First, they denied the Department of war to use their AI to conduct military operations and throughout all this, Anthropic has been the one to neuter their model and make sure that it’s not able to do a lot of things that might can be destructive. So them saying that there should be a pause on new AI and then releasing this new product makes me inclined to believe them. Maybe I’ve drank the koolaid but it seems like Anthropic isn’t inherently “evil.”

amazingamazing

Yes. > We’re proposing stronger regulation of the technology. We’re proposing giving the government the ability to, again in a narrow way, block deployment of unsafe technology. Anthropic CEO, last week. https://abc7.com/post/anthropic-ceo-dario-amodei-calls-stron...

s3p

> if it is determined, in light of third-party assessment, to present unacceptable risks. >Yes. This assessment was made by Amazon, a frequent and serious government contractor which is generally trusted to handle high-security government, intelligence, and military contractor concerns. Reads as partially disingenuous. Amazon did not conduct some thoroughly vetted, responsible security audit. Someone gave them examples of a 'jailbreak' and they notified the white house rather quickly. This was nary an official process. Calling it one is ignoring the facts of what happened.