23 points mikestew 1 hour ago 5 comments

ferrouswheel 12 minutes ago | parent

Add him to the impeachment list.

It's getting quite long with all the blatent criminals currently in the whitehouse.

schiffern 10 minutes ago | parent

"Refute" makes it sound like there's juicy insider info, but it's just skepticism that FAA scheduled upgrades on a Friday daytime.

This was a cascading multicast failure, which can take hours to build up. Earliest reports of disruptions came no later than 10:30 am, so it's quite possible the upgrades were performed in the overnight hours on Thursday.

alexpotato 9 minutes ago | parent

Long time SRE/DevOps with 20 year of FinTech experience in banks/hedge funds/crypto and having seen many, many outages (some listed here [0]):

- There is almost always a standard operating procedure (SOP)

- Just b/c there is a SOP for releases etc, that doesn't mean that people always follow it

- This can be due to many reasons e.g. laziness, being distracted, pressure from higher ups ("just push it out there and I'll take the risk" ha!), tired from having a newborn etc etc

- Doing things outside the "green zone" deployment windows therefore always carries risk

- All of this being said, EVEN IF you ARE following SOP, things still break in all kinds of weird ways

- And the end user is not often the best observer nor do they have all of the context to determine what broke, how it broke and why. (There are exceptions to this though)

0 - https://x.com/alexpotato/status/1215876962809339904

jmclnx 2 minutes ago | parent

Tin foil hat on: Microsoft Cloud issues ? aka Office 365 over the same period :)