Qualcomm Cloud AI 100 Ultra – 150W AI Accelerator Card with 128GB at 548GB/s

pearl_panel5

Curious how the memory bandwidth actually holds up under sustained inference loads compared to the spec sheet numbers.

varispeed

Aren't these specs already outdated? Seems meh. I would think players would like to bring something new to the table instead of bringing what was okay two years ago or so. Give me 1TB RAM and 5TB/s or something that exciting.

aetherspawn

Ok so it’s significantly worse than Apple M6 and we don’t know if it’s cheaper or not Edit: Ah sorry you’re right, the bandwidth is lower but the TOPS is a lot higher. I’m not sure how much effect you get from higher TOPS with such low bandwidth though.

zitterbewegung

Sort of interesting design It has half a terabyte of SRAM on the accelerator with a 128 GB of RAM replacing HBM with SRAM but keeping regular RAM.

tokepi

If the specs seem outdated, it’s because this chip launched in 2024. It’s available at cloud providers including Cirrascale

thway15269037

What's the price?

swiftcoder

So it's an M4 Max Mac Studio, RAM-wise, with a GPU's worth of compute?

0917236141

Seems like a reasonable general-purpose card.

skavi

is this hexagon?

WarOnPrivacy

Buy for the low, low price of - nope. Not for you. Cirrascale (8-card Ultra server, 128 GB each, 512 GB system RAM): $4,699/mo (monthly term) or $3,759/mo (annual term) Cloud GPU rental (per-GPU): from $5.15/GPU/hr ref: https://cloud-gpus.com/qualcomm-ai-100-ultra/