Railway Is Having a Major Outage

iloveplants

seems like it's every day

throwaranay4933

This screenshot from Discord suggests the idea that the outage is caused by automated GCP account ban: https://x.com/acgfbr/status/2056866780866351323

faangguyindia

Google cloud also locked out a Korean Goverment Organization recently. The guy posted on GCP subreddit. Google really need to improve their support team. It's strange such a big corp can't even afford to have proper support team.

mcontrerazCL

all my fkn postgres bd in railways! what do i do now?

ryanisnan

Yikes. I was wondering why my TLS certs were coming up as invalid.

eoswald

Sorry, I have a hard time blaming Google for this, when Railway seems to be having increasing trouble keeping the platform stable. Something like this should NOT take down an ENTIRE service. There should be a backup when literally your business is about being the reliable backend. This just seems like poor planning to me.

brokenodo

I’m a new customer and have been falling in love with Railway over the last 2 weeks, but this is quite the wake up call.

Mengkudulangsat

That explains why all my vibe-coded hobby projects are down. Thank God I'm not dealing with any public-facing sites! Would have been an expensive lesson for a newbie coder if my job depended on this.

rekabis

TL;DR: putting all your eggs into one basket is bad, man.

bshack0

so....what are we switching to y'all? cloud-run ? ;P

bshack0

so...what are we switching to yall? cloud-run :P

enahs-sf

I respect what railway is doing but also would never run my business on such a platform.

fjni

Wait… railway runs on GCP? Didn’t they make a whole thing about not “building a cloud on top of another cloud?” Or did they just mean that they’re not renting VPSs but only metal from the cloud provider? In my mind I was so excited that there was another provider not just paying one of the hyperscalars but at a minimum colocating and owning more of their stack. https://blog.railway.com/p/heroku-walked-railway-run

Avicebron

Isn't Railway the "the API key to delete the backups is in the prod database, because that's where the backups live duh" guys?

TheTaytay

I’ve seen a few smug “all your eggs in one basket” comments here. I’m aware of some companies hosting their own metal and infra, but I’m not aware of large companies mitigating risk by hosting on separate cloud providers as a fallback mechanism. We might disagree with cloud provider choice, or think they should have been hosting their own metal, but that’s still an “all your eggs in one basket” choice, right? Heck, they might even have multi-region fallback with GCP, but if GCP bans your account, that doesn’t matter. Are there good examples of running a company of railway’s size so redundantly that their host could nuke one of their accounts and they’d just keep on trucking?

dwa3592

Wait, I thought railway was a cloud provider like AWS, GCP but better and more agile. At least that's the impression i got from their website.

whh

This could kill a startup. I really don't like Google's automated and silent account murder functionality.

Drew-Aetherwave

It is killing me...

Osborn_Ojure

compute recovered, get ready boys!

leventhan

What's a good alternative to Railway?