
Microsoft identifies months-old bug as a root cause of global outage
Microsoft has identified the root causes of the global outage that crippled Outlook, Exchange and other vital office software last week.
The office software giant issued an initial report on Monday that identified three factors leading to the 24-hour blackout: a months-old bug, malfunctioning internal connections, and server capacity. Each factor could have been resolved individually, but together they caused a major outage that was difficult to mitigate, Microsoft executives said.
The disruption began Thursday when US users reported interrupted access to Outlook email accounts. By the next day, millions worldwide couldn't access email or other Office 365 services. Jails couldn't release prisoners, hospitals used paper records, schools lost contact with parents, and police departments couldn't receive crime reports.
Microsoft resolved the issue by Saturday and issued an apology, stating the blackout wasn't caused by a cybersecurity breach. The company plans to publish a final report with more details.
Bug and system failure
In a post on X, Charles Lamanna explained that a latent bug from July caused Microsoft's servers to become overwhelmed and unresponsive. Typically, Microsoft has two networking gateways, but one wasn't working for Microsoft Teams, overwhelming the primary gateway.
Over 14% of the company's server capacity was also not working due to an unrelated issue from the previous day. Recovery took longer because returning servers were immediately overwhelmed by waiting traffic and became unresponsive again.
Impact and lessons
Analysts say the outage highlights the need for companies to examine their reliance on single operating systems. The widespread disruption to essential services demonstrates the broad impact system outages can have.