Moneycontrol PRO
HomeNewsTechnologyExplained: What led to Facebook, Instagram, WhatsApp's global outage

Explained: What led to Facebook, Instagram, WhatsApp's global outage

Facebook blamed the "faulty configuration change" for nearly six hours of global outage adding that its internal tools and systems were also impacted complicating attempts to diagnose and resolve the problem.

October 05, 2021 / 10:23 IST
Facebook Inc blamed a "faulty configuration change" for a nearly six-hour outage on Monday that prevented the company's 3.5 billion users from accessing its social media and messaging services such as WhatsApp, Instagram and Messenger.

Social media giant Facebook and its two affiliates WhatsApp and Instagram were down for nearly six hours on October 4 with users around the globe leaving users confused and in disbelief over the large-scale outage.

The outage also triggered a sell-off in the stock market with Facebook’s CEO Mark Zuckerberg’s personal wealth slashing nearly $6 billion in a matter of hours.

The stocks fell nearly 4.9 percent on October 4 cumulating to a 15 percent drop since mid-September, Bloomberg reported.

What happened?

Facebook blamed the "faulty configuration change" for nearly six hours of global outage adding that its internal tools and systems were also impacted complicating attempts to diagnose and resolve the problem.

"Our engineering teams have learned that configuration changes on the backbone routers that coordinate network traffic between our data centers caused issues that interrupted this communication. This disruption to network traffic had a cascading effect on the way our data centers communicate, bringing our services to a halt," Facebook noted.

Expanding on Facebook's statement on the root cause behind the outage, tech experts explain a Domain Name System (DNS) mishap.

“Their [Facebook and its affiliates] DNS names stopped resolving, and their infrastructure IPs were unreachable. It was as if someone had "pulled the cables" from their data centers all at once and disconnected them from the Internet,” two senior Engineers at Cloudflare, a web infrastructure and Web security company explained in a blog post.

Capture

According to the duo, Facebook stopped announcing routes to its DNS server through Border Gateway Protocol (BGP), a mechanism to exchange routing information between autonomous systems (AS) on the Internet.

Simply put, the internet that is connected through several networks, exchanges route information constantly to deliver every network packet to their final destinations. These networks are bound together by BGP that allows Facebook and other websites to advertise their presence to other networks that form the Internet, which went offline causing the outage.

When anyone tries to reach Facebook in the browser through its URL https://facebook.com, the DNS resolver that translates this domain into the IP address checks the cache and uses it. In case, there is no such cache available, it answers by the domain nameservers, typically hosted by the entity that owns it. If such nameservers are also unavailable or fail to respond, the browser displays an error to the user.

“At 1658 UTC we noticed that Facebook had stopped announcing the routes to their DNS prefixes. That meant that, at least, Facebook’s DNS servers were unavailable. Because of this Cloudflare’s 1.1.1.1 DNS resolver could no longer respond to queries asking for the IP address of facebook.com or instagram.com,” the blog reiterated along with a screenshot of the failed Facebook DNS servers.

Meanwhile, other Facebook IP addresses remained routed but weren’t particularly useful since without DNS Facebook and related services were effectively unavailable, it added.

Essentially, Facebook and its affiliates disconnected themselves from the Internet.

Coincidently, the outage came a day after “Facebook’s whistleblower” appeared in a major interview on ‘60 Minutes’ alleging that the tech giant knew its products were fueling hate and harming children's mental health.

Impact

As the most popular social media networks went down around the world, more people resorted to other messenger applications like Signal that saw a sudden surge in downloads.

People look for alternatives and want to know more or discuss what’s going on. When Facebook became unreachable, we started seeing increased DNS queries to Twitter, Signal and other messaging and social media platforms, the blog noted.

“Signups are way up on Signal (welcome everyone!) We also know what it’s like to work through an outage, and wish the best for the engineers working on bringing back service on other platforms #Mondays,” Signal confirmed in a Twitter post.

The outage was also a reminder about the scale at which Facebook, Whatsapp, and Instagram connect the people around the world and its impact.

Invite your friends and family to sign up for MC Tech 3, our daily newsletter that breaks down the biggest tech and startup stories of the day

Smriti Chaudhary
first published: Oct 5, 2021 09:42 am

Discover the latest Business News, Sensex, and Nifty updates. Obtain Personal Finance insights, tax queries, and expert opinions on Moneycontrol or download the Moneycontrol App to stay updated!

Subscribe to Tech Newsletters

  • On Saturdays

    Find the best of Al News in one place, specially curated for you every weekend.

  • Daily-Weekdays

    Stay on top of the latest tech trends and biggest startup news.

Advisory Alert: It has come to our attention that certain individuals are representing themselves as affiliates of Moneycontrol and soliciting funds on the false promise of assured returns on their investments. We wish to reiterate that Moneycontrol does not solicit funds from investors and neither does it promise any assured returns. In case you are approached by anyone making such claims, please write to us at grievanceofficer@nw18.com or call on 02268882347