Network failure during unrelated maintenance causing total service outage

A network failure as a result of maintenance staff working on unrelated equipment caused an outage lasting approximately 10 hours.

What went wrong?

During the maintenance staffs work, they bumped a powerline ethernet adaptor enough that it briefly lost connection. Since other equipment was plugged into it which didn't go offline, I was unaware that this had happened

Why such a long outage?

Since I wasn't aware of this outage, and I'm not automatically notified, I wasn't aware that this was an issue for several hours. Upon discovery of the issue, I still could not work to bring the equipment back online as other people were dependant on the equipment connected to the disloged powerline adaptor so I could not fully disconnect it to restart it.

Once the adaptor was restarted, the system did not recover so I had to hard reset it which took even longer as this had to be timed correctly and all affected equipment had to be disconnected before this could take place. This combination of factors resulted in a nearly 10 hour long outage.

How can this be improved next time?

I will continue to look into redundant networking for the future but this may not be possible as a full failover and may instead have to be a temporary 4G/5G backup solution.

Closing notes

As this was thankfully just a network outage, no data was harmed and no inflight data was being processed and all systems followed proper shutdown procedures to ensure data integrity so no data was lost. With that in mind, the service is now back up and running and should be for the foreseeable future. I'm sorry for any inconvenience this caused.

The service is now back online and working as intended. This incident will now conclude.

The powerline networking this service relies on had a temporary outage as a result of being bumped out of place by maintenance techs as a result of Virgin Media's maintenance work on unrelated infrastructure nearby. The service is now recovering and should be online within a few minutes.

Photo Sharing Service went down.