Arm AGI CPU

RealityVoid

Arm apparently now sells their own CPU's.

throwa356262

AGI = Agentic AI Infrastructure In case you were thinking about some other abbreviation...

nurettin

I was wondering who convinced ARM to manufacture hardware. Turns out it was Meta.

vova_hn2

I found this article extremely frustrating to read. Maybe I lack some required prior knowledge and I am not the target audience for this. > built on the Arm Neoverse platform What the heck is "Arm Neoverse"? No explanation given, link leads to website in Chinese. Using Firefox translating tool doesn't help much: > Arm Neoverse delivers the best performance from the cloud to the edge What? This is just a pile of buzzwords, it doesn't mean anything. The article doesn't seem to contain any information on how much it costs or any performance benchmarks to compare it with other CPUs. It's all just marketing slop, basically.

papichulo2023

What does "Built for rack-scale agentic efficiency" even means?

yabutlivnWoods

How fun would it be if due to improved chips handling more model state RAM needs are reduced and Sama cannot make all those RAM purchases he booked? VC without a degree who has no grasp of hardware engineering failed up when all he had to do was noodle numbers in an Excel sheet. He is so far behind the hardware scene he thinks its sitting still and RAM requirements will be a nice linear path to AGI. Not if new chips optimized for model streaming crater RAM needs. Hilarious how last decades software geniuses are being revealed as incompetent finance engineers whose success was all due to ZIRP offering endless runway.

rvz

Meta are heavily invested in building their own chips with ARM to reduce their reliance on Nvidia as everyone is going after their (Nvidia) data center revenues. This is why Meta acquired a chip startup for this reason [0] months ago. [0] https://www.reuters.com/business/meta-buy-chip-startup-rivos...

mkl

This is like naming your kid World President Smith.

SilverElfin

Call this an “AGI CPU” just feels like the most out of touch, terrible marketing possible. Maybe this is unfair but it makes me think ARM as a whole is incompetent just because it is so tasteless. > Arm has additionally partnered with Supermicro on a liquid-cooled 200kW design capable of housing 336 Arm AGI CPUs for over 45,000 cores. Also just bad timing on trying to brag about a partnership with Supermicro, after a founder was just indicted on charges of smuggling Nvidia GPUs. Just bizarre to mention them at all.

steve1977

I think the interesting bit is actually this: For the first time in our more than 35-year history, Arm is delivering its own silicon products

aurareturn

This is just a Neoverse CPU that Arm will manufacture themselves at TSMC and then sell directly to customers. It isn't an "AI" CPU. There is nothing AI about it. There is nothing about it that makes it more AI than Graviton, Epyc, Xeon, etc. This was already revealed in the Qualcomm vs Arm lawsuit a few years ago. Qualcomm accused Arm of planning to sell their CPUs directly instead of just licensing. Arm's CEO at the time denied it. Qualcomm ends up being right. I wrote a post here on why Arm is doing this and why now: https://news.ycombinator.com/item?id=47032932

rafram

AGI (Agentic AI Infrastructure) is joining CSS (Compute Subsystems) in their lineup, apparently. Who’s naming this stuff?

twostorytower

And the stock is down >2% today

jeffbee

Many of these words are unexplained. "Memory and I/O on the same die". Oh? What does this mean? All of the DRAM in the photo/render is still on sticks. Do they mean the memory controller ? Or is there an embedded DRAM component?

midnightdiesel

What a product name choice! I wasn’t expecting ARM to pivot to selling snake oil.

josemanuel

Interesting that Jensen Huang joined in the congratulations for this new product!

torusle

ARM riding the "everything is AI" train. So sad.

DeathArrow

Now every product will have the AI buzzword in it's name, just like 25 years ago product names started with letter e, from electronic. So we will see AI Toilet Paper launching in the next months.

bt1a

Oh wow already in use by Meta, OpenAI, and more ?? https://www.arm.com/products/cloud-datacenter/arm-agi-cpu/ec... The TDP to memory bandwidth& capacity ratio form these blades is in a class of its own, yes?

bobmcnamara

6GB/s/core That's...not much right? Maybe it's a lot times N-cores? But I really hope each individual core isn't limited to that. Edit: 17 minutes to sum RAM?