this post was submitted on 18 Nov 2025
293 points (99.0% liked)

Selfhosted

53057 readers
972 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS
 

I always love it when some massive piece of web infrastructure goes down but most websites I use are self-hosted so the only real effect is I see lots of news stories that cloudflare is down.

top 50 comments
sorted by: hot top controversial new old
[–] mesamunefire@piefed.social 43 points 2 days ago (4 children)

So far this year its been:

  1. AWS was massively down
  2. Azure was down a week later
  3. Cloudflare down multiple times this year

Thats the ones that affect stuff at work. Fun times.

[–] possiblylinux127@lemmy.zip 3 points 1 day ago

My services have a higher uptime than AWS, Azure and Cloudflare despite the fact that they are running on 10 year old hardware

[–] pinball_wizard@lemmy.zip 3 points 1 day ago (1 children)

Dang. I had to look it up, but CrowdStike taking down a huge percentage of Windows PCs was so last year, I guess.

[–] possiblylinux127@lemmy.zip 1 points 1 day ago

"Whoops"

  • some person at Cloudstrike, probably
[–] lepinkainen@lemmy.world 8 points 2 days ago (2 children)

Azure was down? Did anyone notice? 😆

[–] viking 2 points 2 days ago

If you're stuck with Windows at work, you might have. I couldn't log on to our domain remotely and was unable to open some documents and emails that were signed as "internal use only".

load more comments (1 replies)
[–] voodooattack@lemmy.world 4 points 2 days ago

It’s a vibe.

[–] iii@mander.xyz 63 points 2 days ago (4 children)

Is there any meta analysis on these major outages?

They seem to be occuring more and more regularly.

[–] southernbeaver@lemmy.world 53 points 2 days ago (2 children)

It would be funny if it was because of some AI coding

[–] pinball_wizard@lemmy.zip 1 points 1 day ago

It would be funny if it was because of some AI coding

It is. Sometimes the big secret turns out to just be what we all thought was happening.

[–] Subscript5676@lemmy.ca 3 points 2 days ago

Please don’t remind me. Had a colleague with a senior title who just vibecoded on our CI pipeline and it ended up blocking deployments for half a day.

[–] 30p87@feddit.org 30 points 2 days ago (1 children)

Maybe Kevin Fang will make a video about all combined?

My prejudice tells me that it's vibe slopped code.

[–] UsedLinuxDealer@lemmy.world 8 points 2 days ago (1 children)

I saw people speculating about this, but it'll be interesting to see if that's really what it was (and if so, if they'd admit it).

[–] pinball_wizard@lemmy.zip 2 points 1 day ago* (last edited 1 day ago)

I'm sure it was, and I'm sure they will not admit it.

So I'll throw this into the "conspiracy theory, but probably true" pile; and I'll try to remember to check snopes.com in 20 years to see if I was somehow wrong.

"Did Vibe coding really routinely break half the Internet is the 2020s?" ...assuming the Internet and I are still both around by then...

Edit: I'm already wrong. It sounds like it was computers being stupid is old tried and true ways; not computers being stupid in new trendy ways.

[–] frongt@lemmy.zip 7 points 2 days ago (4 children)

Preliminary articles say this was a DDoS.

[–] Anafabula@discuss.tchncs.de 24 points 2 days ago (1 children)

A DDoS that brings down the biggest(?) DDoS protection provider?

[–] eager_eagle@lemmy.world 5 points 2 days ago

def possible, cloudflare DDoS their own dashboard a few months ago with some react code

https://blog.cloudflare.com/deep-dive-into-cloudflares-sept-12-dashboard-and-api-outage/

load more comments (3 replies)
[–] irmadlad@lemmy.world 4 points 2 days ago (2 children)

As far as major outages, I can only think of around 10 going back 5 years. Sure there have been minor hiccups and glitches, but gosh, that's life on the internet.

[–] pinball_wizard@lemmy.zip 2 points 1 day ago

It does feel like the major outages are growing closer together.

I want to blame plugging AI where it doesn't belong, but I suppose that putting everything into the same couple of server closets could be the primary root cause.

[–] BremboTheFourth@piefed.ca 4 points 2 days ago* (last edited 2 days ago) (2 children)

Yeah I have issues with my home setup at least that often. I can only think of two occasions where the solution took more effort than a reboot. Maybe we're all just old enough for "every 6 months" to feel like every 5 mins

To clarify, by "issues" I mean "system stoppages not precipitated by me fucking with something." I screw up my own system way more often than that lol

[–] pinball_wizard@lemmy.zip 1 points 1 day ago

I screw up my own system way more often than that lol

Same! But the ones I cause don't count.

[–] irmadlad@lemmy.world 3 points 2 days ago

I don't know how old you are brother, but it feels like I'm in one of those Star Trek warps where all the stars are just whizzing by.

[–] nuko147@lemmy.world 41 points 2 days ago (8 children)

I Guess many lemmy instances are not as much decentralized as they thought.

[–] mesamunefire@piefed.social 18 points 2 days ago (1 children)

Cache-ing is a hard problem to solve. For MANY years cloudflare was the cheapest and easiest way to solve the issue.

But the same people that started cloudflare have moved on or passed away. Now its just another corp. So yeah we are going to get downtime. In the corporate world, its the standard so no one is going to move off it.

...unless it keeps going down consistently.

For those who are in the know, does memcache work with lemmy/piefed? What is a good Cache for modern day systems?

[–] possiblylinux127@lemmy.zip 2 points 2 days ago* (last edited 2 days ago)

Honesty we need a open standard for caching and csam detection.

[–] mhzawadi@lemmy.horwood.cloud 13 points 2 days ago (1 children)

I dont use cloudflare at all, so I didnt notice. I do see a lot of recommendation's to host behind Cloudflare, so if they have a problem you do too

[–] irmadlad@lemmy.world 6 points 2 days ago

I do see a lot of recommendation’s to host behind Cloudflare, so if they have a problem you do too

Fallback to Tailscale, or any number of ways to skin the cat. At the very least, everything is accessible locally. I'm not running anything mission critical, so it was more of a minor inconvenience to me.

[–] Eyekaytee@aussie.zone 8 points 2 days ago* (last edited 2 days ago) (1 children)

aussie.zone sh.itjust.works lemmy.world

all were down for me

[–] TrickDacy@lemmy.world 4 points 2 days ago (1 children)

Piefed.social was too, on my end

load more comments (1 replies)
load more comments (5 replies)
[–] aarRJaay@lemmy.world 31 points 2 days ago (1 children)

"Further details will be made available when we've worked out how the AI screwed us this time"

[–] adb@jlai.lu 7 points 2 days ago (1 children)

This really should read: further details will be made available when our AI api is back up and can self-report on how it fucked up

load more comments (1 replies)
[–] swizzlestick@lemmy.zip 20 points 2 days ago

Eggs, baskets, and lessons being taught about how it's not a good idea to heavily skew their ratio.

[–] comrade_twisty@feddit.org 20 points 2 days ago (1 children)

I am still using cloudflare tunnels for home assistant, so I am a little annoyed. On the other hand this was a much needed reminder that I need to move home assistant to pangolin/newt as well.

[–] Damage@feddit.it 6 points 2 days ago

NAT may be insecure but it keeps chugging on

[–] DonutsRMeh@lemmy.world 17 points 2 days ago

My own DNS is still up and strong. Take that, Cloudflare.

[–] db0@lemmy.dbzer0.com 12 points 2 days ago (1 children)

took much of lemmy.world down. I wonder how come I'm seeing some posts from lemmy.worlders though

load more comments (1 replies)
[–] Confining@lemmy.dbzer0.com 8 points 2 days ago (1 children)

I don’t use cloudflare but the only reason I noticed is a lot of websites I go on use cloudflare captcha due to me using a vpn. Now I can’t even get on those website due to the captcha being down 😭

load more comments (1 replies)
[–] Aertbei@discuss.tchncs.de 7 points 2 days ago (2 children)

I was having DNS issues yesterday using cloudflare's DoH, so I'm curious if it is going to be related.

[–] Uri 4 points 2 days ago

I wish they go down more, at least once a month.

[–] bjoern_tantau@swg-empire.de 5 points 2 days ago

And it's taken down most of Lemmy's "selfhosted" images.

[–] tal@lemmy.today 4 points 2 days ago

Took down Framework's website, which I was using.

[–] jlow@discuss.tchncs.de 2 points 2 days ago

I almost didn't notice and the all sites I wanted to look had had been archived on archive.org

load more comments
view more: next ›