Claude Fable 5.2 scores 65 on Artificial Analysis, highest so far

qntty

Crazy how quick these are coming out now

suddenlybananas

Why is it so much more expensive?

A_D_E_P_T

Google could have been #1 for a little while, but they botched their release and squandered their temporary lead. (As usual.) If I worked there, I'd be so pissed.

rgbrenner

Forget about the scores... look at the Cost Per Task. Fable 5.1 was already the most expensive by a good margin, and now Fable 5.2 doubles it! This is with the price cut. The output tokens per task just exploded. From 118k tokens (46k Answer/71k Reasoning) in 5.1 to 274k tokens (81k Answer/192k Reasoning) in 5.2.

gizmodo59

https://artificialanalysis.ai/#intelligence-efficiency-tabs this is the chart that matters for most of poor developers and companies. Pareto for a given intelligence index and looks like only openai is across the quadrant with muse at the bottom. They have really cooked efficient models!

oliwary

Cool! It looks like Fable 5.2 (especially low and medium) also sit on the pareto frontier between time per task and intelligence: https://artificialanalysis.ai/models?speed=output-speed-over... I am always interested in this comparison since it shows how quickly you can go back and forth with a model, capturing both tokens/task and tokens/second. The new models seem to be meaningfully better here.

ProblemExplorer

Fable, for me (it might be a completely different experience for you) has been like the well read snobbish kid at school that openly ignores me when I ask certain questions and often asks me to talk to someone else on other questions. That kid might indeed be a genius, clearly bright, but is more interested in deciding whether I should have asked a question than in answering it. For me personally, if the best model on the planet refuses to answer why I shouldn't mix bleach and ammonia, where I'm trying to understand the chemistry behind the warning, it's not pareto frontier to one that atleast tries to and points me in a general direction. Being told that the topic is concerning, referred to someone else and charged part of my quota for that experience feels like getting an invoice from that school genius for telling me to "just ask the chemistry teacher". If my LLM asks me to rethink my life when I ask it to reverse engineer the firmware of my Samsung TV that I suspect is setting up adhoc radio networks to relay my data to Samsung's cloud, I feel rather sad, specially when that kid sends me an invoice for saying "no" At least Anthropic should not bill me for the refusal (as of my last tests, refusals still comes out of my quota) - getting slapped and pickpocketed for asking a question is really upsetting.

pmdr

Splendid. Now how many prompts in you're downgraded to Opus 4.8 and then the chat is ended altogether?

Daunk

Don't worry, it'll soon get dumbed down in a few weeks :)

Aurornis

The Artificial Analysis charts are great, but be warned that they show max effort by default. Max effort is nice for revealing the limits of a model, but it's almost never used in practice. If you scroll down to the coding charts you can start adding Fable 5.2, Opus 5.5, and others at more normal difficulty settings. Fable 5.2 on medium looks quite attractive compared to Opus 5.5 high/xhigh Fable 5.2 on max (the default) looks like a good way to light your money on fire.

vbroot

It does not seem profitable as those prices.

aleqs

Artificial Intelligence is bullshit. There, I said it.

mutech53

I am wondering which use cases would require usage from Fable 5.2 especially when Opus 5.5 already performs almost all of the tasks in a very optimized way.

schnitzelstoat

That seems like an insane increase in cost for a modest intelligence increase. But perhaps the performance on real-world tasks will be more noticeable than on benchmarks.

nedsma

Fable 5.2 at high is the real thing here - scoring 62, second highest ever, on AA intelligence index, while being 3x less expensive.

t0md4n

8 points higher than Astra for 4.2x the cost and 5x the output tokens. Is it worth it? Edit: high seems better than max

lynguist

So... Astra 6.1 will come next week and be the same ultraexpensive one but from OpenAI, right?

baxuz

It's funny how the cost graph is completely different to what anthropic is trying to sell on their release post.

cedws

Long execution time makes this not very impressive. It's easy to benchmaxx if you give the model an insane compute budget and room to just brute force the problem. Efficiency is what actually matters.

motbus3

It is about time to start setting taxes for ai usage in commercial settings and set how to transition to a society with less available work. They talk so much we need universal benefits, about time for them to start paying for it