STOCK MARKET BSE NSE

Facebook says global outage caused due to error during routine maintenance

Once connectivity was restored, services were brought back gradually to avoid traffic surges that could cause more crashes.

Published: 06th October 2021 05:50 PM  |   Last Updated: 06th October 2021 05:50 PM   |  A+A-

Facebook, whatsapp

Engineers scrambled to fix the problem on site, but this took time because of the extra layers of security. (File Photo)

By PTI

LONDON: The global outage that knocked Facebook and its other platforms offline for hours was caused by an error during routine maintenance, the company said.

Santosh Janardhan, Facebook's vice president of infrastructure, said in a blog post that Facebook, Instagram and WhatsApp going dark was "caused not by malicious activity, but an error of our own making."

The problem occurred as engineers were carrying out day to day work on Facebook's global backbone network; the computers, routers and software in its data centers around the world along with the fiber-optic cables connecting them.

"During one of these routine maintenance jobs, a command was issued with the intention to assess the availability of global backbone capacity, which unintentionally took down all the connections in our backbone network, effectively disconnecting Facebook data centers globally," Janardhan said Tuesday.

Facebook's systems are designed to catch such mistakes but in this case a bug in the audit tool prevented it from properly stopping the command, Janardhan said.

That change also triggered a second problem that made things worse by making it impossible to reach Facebook's servers even though they were operational.

Engineers scrambled to fix the problem on site, but this took time because of the extra layers of security, Janardhan said.

The data centers are "hard to get into, and once you're inside, the hardware and routers are designed to be difficult to modify even when you have physical access to them."

Once connectivity was restored, services were brought back gradually to avoid traffic surges that could cause more crashes.



Comments

Disclaimer : We respect your thoughts and views! But we need to be judicious while moderating your comments. All the comments will be moderated by the newindianexpress.com editorial. Abstain from posting comments that are obscene, defamatory or inflammatory, and do not indulge in personal attacks. Try to avoid outside hyperlinks inside the comment. Help us delete comments that do not follow these guidelines.

The views expressed in comments published on newindianexpress.com are those of the comment writers alone. They do not represent the views or opinions of newindianexpress.com or its staff, nor do they represent the views or opinions of The New Indian Express Group, or any entity of, or affiliated with, The New Indian Express Group. newindianexpress.com reserves the right to take any or all comments down at any time.

edexworks
flipboard facebook twitter whatsapp