Kitz Forum

Broadband Related => Known Network Issues + MSO's => Topic started by: highpriest on July 20, 2016, 10:09:15 AM

Title: BT and Plusnet Outage
Post by: highpriest on July 20, 2016, 10:09:15 AM
Looks like there's a significant ongoing issue at the moment. Access to lots of websites are affected.

https://twitter.com/BTCare/status/755676292717088768
https://twitter.com/plusnethelp/status/755677360620466176

Lots of our home workers are affected (most are on BT connections).
Title: Re: BT and Plusnet Outage
Post by: ryan2390 on July 20, 2016, 10:20:27 AM
There is indeed. So far the best workaround I've found is to use OpenDNS as their DNS servers seem to be in total melt down.

BBC and the The Telegraph have picked up the story. If you can get it to load here is the link to the Telegraph article: http://www.telegraph.co.uk/technology/2016/07/20/bt-down-broadband-service-suffers-major-outage-across-the-uk/
Title: Re: BT and Plusnet Outage
Post by: tbailey2 on July 20, 2016, 10:33:10 AM
Unfortunately none of the links work due DNS failure  :-\  I use OpenDNS but no go. MDWS badly affected with around 40% of users vanished in past few hours.
Title: Re: BT and Plusnet Outage
Post by: Bowdon on July 20, 2016, 10:42:03 AM
I'm seeing slow browsing to websites.. some even don't load at all.

One of my games launchers won't load up properly either.. so it must be some routing issue going on, as google seems to come up instantly and facebook.

http://www.ispreview.co.uk/index.php/2016/07/bt-network-fault-affecting-uk-internet-broadband-services.html (http://www.ispreview.co.uk/index.php/2016/07/bt-network-fault-affecting-uk-internet-broadband-services.html)
Title: Re: BT and Plusnet Outage
Post by: tbailey2 on July 20, 2016, 10:46:19 AM
This site can’t be reached

ww.ispreview.co.uk (http://www.ispreview.co.uk)’s server DNS address could not be found.
Title: Re: BT and Plusnet Outage
Post by: Dray on July 20, 2016, 10:55:14 AM
Quote
UPDATE 10:21am

According to Entanet, “The problem has been confirmed on BT’s side and they are currently investigating. We haven’t been provided anything relating to the cause as of yet, but we will update upon receipt of this information. Unfortunately the BT systems remain down preventing us from looking into individual line issues.”

UPDATE 10:43am

The official line from BTOpenreach is as follows: “We’re sorry that some BT and Plusnet customers are experiencing problems accessing some internet services this morning. This is due to power issues at one of our internet peering partners’ sites in London. Engineers are working to fix things as fast as possible.” Of course it’s not just BT and Plusnet customers being affected.

On the upside some traffic now appears to have been rerouted and customers are reporting an improvement, but there are still a lot of complaints coming in. We suspect this will be resolved fairly soon.

UPDATE 10:52am

The power failure appears to have occurred at London’s TeleCity data centre.
http://www.ispreview.co.uk/index.php/2016/07/bt-network-fault-affecting-uk-internet-broadband-services.html
Title: Re: BT and Plusnet Outage
Post by: Bowdon on July 20, 2016, 11:01:03 AM
This site can’t be reached

ww.ispreview.co.uk (http://www.ispreview.co.uk)’s server DNS address could not be found.

I'm noticing even BT's website doesn't fully load when trying to login and see the forum. At the moment its half loading. The layout is all over the place.
Title: Re: BT and Plusnet Outage
Post by: highpriest on July 20, 2016, 11:15:58 AM
Looks like it's back to normal (ish) for me. Most websites are now loading fast.
Title: Re: BT and Plusnet Outage
Post by: highpriest on July 20, 2016, 11:29:52 AM
UPS failure killed a key router.

Quote
UPDATE 11:07am

A private report from TeleCity, which was sent to certain providers earlier today and seen by ISPreview.co.uk, suggests that there was a power failure with one of their Uninterruptible Power Supply (UPS) systems at 8/9 Harbour Exchange (LD8) in London.

The fault hit a key router (edge4-tch), although this was technically resolved at 9:15am. However the knock-on impact for ISPs like BT and their clients (consumers, businesses and other ISPs etc.) can often take a little bit longer to resolve (computer networks are complicated animals).

Connections should be slowly getting back to normal.
Title: Re: BT and Plusnet Outage
Post by: renluop on July 20, 2016, 11:45:15 AM
Time to show ignorance again! :-[ :)
I'm on Plusnet's new network. Can I in anyway be affected?

Numpty laugh time! ::)
I thought something was wrong this morning, when I turned on the router. It was ages coming up, until I realised the DSL lead was disconnected. Age or stupidity ot combination, I don't know! :wall:
Title: Re: BT and Plusnet Outage
Post by: ryan2390 on July 20, 2016, 11:49:19 AM
UPS failure killed a key router.

One UPS caused this failure?! ONE?!

Blimey. Maybe it's me but surely BT should have multiple redundancies to stop this kind of thing happening?
Title: Re: BT and Plusnet Outage
Post by: RayW on July 20, 2016, 12:08:24 PM
It is more the knock on effects that resulted from the failure.

http://www.theregister.co.uk/2016/07/20/telecity_power_outage_bt_offline/
Title: Re: BT and Plusnet Outage
Post by: Black Sheep on July 20, 2016, 12:24:28 PM
Lots of engineers affected nationwide, too. Me being one of them !!  ::)  :)
Title: Re: BT and Plusnet Outage
Post by: ryan2390 on July 20, 2016, 01:35:28 PM
Lots of engineers affected nationwide, too. Me being one of them !!  ::)  :)

I hope ours turns up today then.  ;)
Title: Re: BT and Plusnet Outage
Post by: tommy45 on July 20, 2016, 05:24:47 PM
The only sites i found to be affected were  banking sites like natwest , rbs, lloyds, ect all other sites were working fine
Title: Re: BT and Plusnet Outage
Post by: daveesh1 on July 20, 2016, 06:37:06 PM
That explains my increase in latency packet loss and unable to load any websites this morning. Running now but still would say a bit on the slow side
Title: Re: BT and Plusnet Outage
Post by: NewtronStar on July 20, 2016, 08:14:32 PM
Lots of engineers affected nationwide, too. Me being one of them !!  ::)  :)

You can imagine the frustration when the engineer finds he can't connected to pokemon go while using openzone  :D
Title: Re: BT and Plusnet Outage
Post by: daveesh1 on July 21, 2016, 09:11:50 AM
Anybody else still having problems this morning
Title: Re: BT and Plusnet Outage
Post by: tbailey2 on July 21, 2016, 09:20:35 AM
Plusnet have a new advisory out as of 09:04 and TBB has a thread or two complaining of poor access...
Title: Re: BT and Plusnet Outage
Post by: kitz on July 21, 2016, 09:20:43 AM
Yep.   Looks exactly the same as yesterday.

Like yesterday, its also affecting this site as I use jquery libraries.
Title: Re: BT and Plusnet Outage
Post by: stevebrass on July 21, 2016, 09:57:54 AM
Latency is up and some sites will not load at all today here is sultry Staffordshire.

I know these things can be complicated but blinking ink! If they tell me where the problem is I'll go round with me screwdriver and fix it.  ;D (with due deference to all BT staff reading this who are pulling their hair out. If they have any left by now).
Title: Re: BT and Plusnet Outage
Post by: d2d4j on July 21, 2016, 10:00:17 AM
Hi

I think it may help if you manually set your DNS servers to google 8.8.8.8

When it has been fixed, you can  change them back

Many thanks

John
Title: Re: BT and Plusnet Outage
Post by: Black Sheep on July 21, 2016, 10:05:37 AM
................ and yes, it's still affecting the engineering workforce as well, to a degree.
Title: Re: BT and Plusnet Outage
Post by: RayW on July 21, 2016, 10:33:44 AM
Seemingly it is a power failure at Telehouse North London ...

It is now (officially) beyond a joke!
Title: Re: BT and Plusnet Outage
Post by: phi2008 on July 23, 2016, 03:44:12 AM
Obviously a cleaner unplugged something to hoover behind a server rack.  :P