Memory executives expect RAM shortage to continue through 2028

konaraddi

Discussed yesterday https://news.ycombinator.com/item?id=49920932

torutofu

yeah, at some point memory footprint becomes an architectural constraint again, not just a number you throw more hardware at.

Invictus0

Can someone please explain to me how the recent llm cache breakthrough doesn't alleviate this memory shortage issue? https://intl.cloud.baidu.com/en/article/8937874

maerF0x0

More like they're praying it does while waiting for more options to vest

Bridged7756

I got a 64gb 6000mt/s kit for 250 recently. Not a humble brag.

cedws

What was the benefit of all this AI stuff again? Because all I see is middle and lower class being fucked over, repeatedly. Increasing prices of consumer electronics, job losses, suffering quality of goods and services, consolidation of power in favor of elites.

vivzkestrel

or you can wait until one of those frontier labs IPO goes bust in a really bad way where it pumps 10x on day 1 and then everyone dumps every share out there and half a million people are holding bags. that ll surely wipe out all the AI hype

bunderbunder

Oracle's recent force majeure invocation shines a spotlight on what seems to be an endemic problem: datacenter builders have been signing commitments to bring a certain amount of capacity online by a certain date, without first conducting sufficient due diligence about whether they would be able to secure all the resources needed to meet those commitments. This means they are now caught in a mad scramble to source all sorts of stuff, including RAM, potentially as a matter of life and death. What's less clear to me, though, is whether datacenter builders will be able to make good on these purchase agreements. It seems these projects have every opportunity to fail, and the path to success keeps getting narrower. What are the odds that chip manufacturers ultimately get caught holding a bag of chips that nobody can buy in one hand, and a bag of IOUs from bankrupt customers in the other?

ChrisArchitect

[dupe] https://news.ycombinator.com/item?id=49920932

Magi604

Was at the computer store yesterday and the RAM I bought for $130 last year is now over $800.

RobotToaster

That's assuming CXMT or another Chinese company doesn't pull something out of the bag.

exabrial

/s/execpt/create/

mmmBacon

Remember when software was eating the world? The gravy train ran out on commodity hardware and now we are paying the price for almost 3 decades of underinvestment.

sharts

Executives expecting $$ as usual

Roark66

The real problem is not that they are buying all the hardware, but that they are buying it and keeping it in bloody warehouses without bringing it online. Because they haven't got DC capacity for it. Has anyone else here been trying to rent some cloud gpus for reasonable money? I have. I have signed up to a dozen "providers" that advertise everything from tesla cards to b200 only to find stuff is either out of capacity or double/triple the price.