Microsoft fiber foul-up cut off Azure California for almost five hours
Maintenance mistake took out 27 services
Azure users who use resources in Microsoft’s West US region endured an uncomfortable day after the tech giant cut off access to its Californian cloud outpost.
As Microsoft explains in its preliminary post incident review, at 14:44 UTC on July 23rd (07:44 AM Pacific Time), the company started “routine device maintenance.”
That effort immediately produced problems.
“Multiple Azure services began to detect and correlate service degradation,” Microsoft’s review reads.
A minute later, Microsoft says folks from its networking and services teams, plus people it describes as “incident responders” began “reviewing traffic anomalies, routing behavior, packet loss signals, and recent changes.”
Microsoft says this sort of maintenance job requires isolating specific network paths, and that it uses a process that “converts these requests into system-readable requests and verifies that at least one of the two redundant paths remains healthy.” We’re told the company makes...
Copyright of this story solely belongs to theregister.com. To see the full text click HERE
