this post was submitted on 04 May 2026
569 points (98.1% liked)

Technology

6793 readers
349 users here now

News community around technology, social media platforms, information technology and governmental policy surrounding it.

What doesn't fit here?

The core of the story has to be technology focused.


Post guidelines

Title formatPost title should mirror the news source title. If you don't like the title of article, look for an alternative source instead of editorializing it.
URL formatPost URL should be the original link to the article (even if paywalled) and archived copies left in the body. It allows avoiding duplicate posts when cross-posting.
[Opinion] prefixOpinion (op-ed) articles must use [Opinion] prefix before the title. Opinion articles refer to articles that their publisher doesn't explictly endorse.
Country prefixCountry prefix can be added to the title with a separator (|, :, etc.) if the news is from a local publisher who doesn't clearly mention the country.


Rules

1. English onlyTitle and associated content has to be in English.
2. Use original linkPost URL should be the original link to the article (even if paywalled) and archived copies left in the body. It allows avoiding duplicate posts when cross-posting.
3. Respectful communicationAll communication has to be respectful of differing opinions, viewpoints, and experiences.
4. InclusivityEveryone is welcome here regardless of age, body size, visible or invisible disability, ethnicity, sex characteristics, gender identity and expression, education, socio-economic status, nationality, personal appearance, race, caste, color, religion, or sexual identity and orientation.
5. Ad hominem attacksAny kind of personal attacks are expressly forbidden. If you can't argue your position without attacking a person's character, you already lost the argument.
6. Off-topic tangentsStay on topic. Keep it relevant.
7. Instance rules may applyIf something is not covered by community rules, but are against lemmy.zip instance rules, they will be enforced.


Companion communities

!globalnews@lemmy.zip
!interestingshare@lemmy.zip


Icon attribution | Banner attribution


If someone is interested in moderating this community, message @brikox@lemmy.zip.

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] merc@sh.itjust.works 32 points 2 weeks ago (3 children)

I've worked on services with 5 nines of availability (i.e. 99.999% available, less than 5 minutes of downtime allowed per year). I've more frequently worked on ones with 4 nines, where you're allowed almost an hour of downtime per year. GitHub is now barely maintaining 2 nines. That's just embarrassing.

Each "nine" you add is much more difficult. To get four nines you need people on call who can start working on a problem within 5 minutes and fix it within a few more minutes, and you can only get those calls once every couple of months. Five nines means that you need people at their desks in shifts ready to start fixing something the moment there's a problem because it would take too long for someone on-call to get their computer out, connect and authenticate. It requires warm backup systems that are sitting idle but ready to take over fully at a moment's notice.

A two nines system is allowed to be down for 100x as long as a four nines system, and 1000x as long as a five nines system. It's almost 15 minutes of downtime allowed per day, compared to about 15 minutes every 3 months for a four-nines system. Gamers wouldn't even put up with a two-nines system for a video game. It's absurd to allow that for a critical piece of infrastructure for software.

[–] p03locke@lemmy.dbzer0.com 10 points 2 weeks ago* (last edited 2 weeks ago) (1 children)

Five nines means that you need people at their desks in shifts ready to start fixing something the moment there’s a problem

No, it means you don't have outages. Ever.

Five-nines is something like 7 minutes of downtime throughout the entire year. At best, you might have automated failover systems that require tiny outages. No human involvement, though, unless you're deal with some major breakage that would have killed the five-nines commitment that year, anyway.

It's takes a human something like 5-10 minutes just to get out of bed and figure out the situation, anyway.

[–] merc@sh.itjust.works 8 points 2 weeks ago (1 children)

No, it means you don't have outages. Ever.

No, that's infinite nines, which isn't possible.

Five-nines is something like 7 minutes of downtime throughout the entire year. At best, you might have automated failover systems that require tiny outages. No human involvement, though, unless you're deal with some major breakage that would have killed the five-nines commitment that year, anyway.

Yes, you have automated failover systems. But, if something happens which causes those systems to fail over, you need to immediately investigate what happened and why. Even at four nines you have automatic failover, redundant system, hot spares, etc. But, you accept that sometimes not everything will work as planned and you'll need to fix something. Five nines is just that and more.

It's takes a human something like 5-10 minutes just to get out of bed and figure out the situation, anyway.

Right, which is why I said that four nines is your realistic maximum if you're going to have people on call who aren't actually at their desks. To get better than four nines you need to have around the clock coverage with people at their desks so when a system breaks you have eyes on it in something like 30s.

[–] Waraugh@lemmy.dbzer0.com 4 points 2 weeks ago* (last edited 2 weeks ago)

I’m used to environments where they expect five nines, get 3 (maybe 4) nines, and fund for 1 nine.

[–] HrabiaVulpes@europe.pub 1 points 2 weeks ago (1 children)

I cal bullshit on "Gamers wouldn't put up with a two-nines system for a video game"

Elder Scrolls Online has a weekly scheduled outage for about 8h. Every monday. Players have been complaining about it for years, but game is still popular.

[–] merc@sh.itjust.works 1 points 2 weeks ago

How often is it offline outside the maintenance windows?

Yeah, maintenance windows are annoying, but they don't really count when describing the availability of a system. Many government systems are only available during normal business hours. That means they're offline for 16 hours per day. What matters is how available they are when they're supposed to be working.

For Elder Scrolls, two nines would mean that the game was allowed to be down for more than an hour a week outside of those maintenance windows. Or, if measured by quarters, which is more typical, the game would still have those maintenance windows, but, in addition, it might be down for a full day once per quarter.

Basically, the 8 hour windows every Monday is a trade-off so that the rest of the week is uninterrupted. They probably manage three nines the rest of the week by shifting any serious maintenance into the weekly downtime.

And, as for the game being "still popular", one site says that there are currently 7199 players in Elder Scrolls but more than 161k in World of Warcraft. It could be that part of the reason that World of Warcraft is more popular is that it doesn't have 8 hour maintenance windows every week, but it does often have 2+ hour windows. The number of players who are willing to put up with 8 hour maintenance windows every week seems pretty small.