Muse Spark 1.1

redox99

Very strong pricing, cheaper than Grok 4.5, particularly the cached reads. We'll have to wait to see if it's actually worth using (it's not on OpenRouter yet).

Tiberium

The pricing is insane: $1.25/$4.5 for 1M tokens, and $0.15 for cached input! https://dev.meta.ai/docs/getting-started/pricing-rate-limits

kilroy123

I personally do not like Meta, but I'll say this. The more competition, the better for regular consumers. (Enterprise too) - Chinese models - Grok - Meta - Google - OpenAI - Anthropic I think this is a win. I'm building like crazy to take advantage of all these subsidized tokens while I can.

greenavocado

Meta is back in the game, albeit not at the top. Impressive stuff, nonetheless.

EgregiousCube

Their published benchmarks seem to indicate that it's pretty good at coding and multimodal, but VERY good at successful tool calls. What kind of use case would be best for that shape?

lnenad

Considering the DeepSWE result (imho if you're gonna give value to benchmarks this is one of the best) it's not good enough.

qpricjalcbeu

Yeah, no thanks. I cannot think of a worse company to trust with additional personal data.

frangonf

Is this the model trained on Meta "draftees"? Are we seeing this in the jump on JobBench?

Jcampuzano2

Competition for cheaper and efficient models is a good thing, regardless of if you don't like SpaceX, Meta, etc. Especially from US based labs I for one am really glad to get competitive models that will push the major labs to bring prices down. While Chinese open source labs are also great, unfortunately when it comes to US/Western political pressure it won't often have as much of a bearing on labs bringing prices down, especially for enterprises. Also if these numbers are true, this is truly breaking ground finally for Meta.

zb3

This is not open-weights, right?

phillipcarter

My trust factor is gone with Meta right now. Has there been any independent analysis to confirm they didn't cheat on benchmarks again?

guluarte

A lot of these benchmarks are unfamiliar. Are labs just choosing the ones that make them look best?

carimura

I missed the fact that Meta was developing and releasing closed-weights models... bummer. Would be great to see some more progress with American open-weights models.

anthonypasq

Everyone has been loving to shit on the Alexander Wang acquisition but this seems legitimately impressive to me? Meta's AI org when from a total mismanaged dumpster fire for multiple years to delivering a competitive model in less than a year on essentially their first try?

GodelNumbering

Lot more details in the linked report https://ai.meta.com/static-resource/muse-spark-1-1-evaluatio... From Terminal-bench-2.1 details, > We use a bash-tool-only agent harness to evaluate 89 Terminal-Bench 2.1 tasks from the official repository, where resources are capped at 6 CPU cores and 8GB RAM. This disqualifies the results. Each terminal bench task has a cpu upper limit and RAM upper limit. Overriding either is disqualification. For reference, in tbench-2.1, 1. 0 out of 89 task allow 6 cpu cores (highest is 4, and i think only 1 task) 2. 8 out of 89 tasks allow 8GB RAM This kind of shady benchmarking (I was talking about it just yesterday in a different context https://news.ycombinator.com/item?id=48838212 ) takes all joy out of building a harness to improve benchmark performance of a model because no matter what you do, you won't beat the headline (cheating) number. This is presumably why this model is not in the official benchmark leaderboard https://www.tbench.ai/leaderboard/terminal-bench/2.1 As an ex Meta employee, this is a little sad but not massively surprising. 'Number go up' is the core performance evaluation metric until PSC is done and you move on.

paxys

How is every company able to show itself at the top of every benchmark?

zmmmmm

Good to see Meta finally back to releasing something at least worth evaluating. And it sounds like they did at least a bit skate to where the puck is going by focusing on tool and computer use.

NitpickLawyer

How are people trying this? I don't see it on openrouter. Any ways of testing this without subscribing to meta stuff?

chvid

Interesting that neither meta nor xai chose to do open source given that they are both clearly behind Google, OpenAI and anthropic - and a serious us open source offering would give them a clear foothold.

bel8

It seems to trade blows with GPT 5.5 and Opus 4.8 in performance while being cheaper than GLM 5.2.