A ROUTER UPDATE could be to blame for the problems experienced by internet users in North America and parts of the UK and Europe yesterday, according to Juniper Networks.
We encountered a problem yesterday when some staffers could not use the Bitly URL shortener. We traced the problem back to the Tier 1 carrier Level3, which later traced it down to Juniper.
In fact for a while yesterday afternoon there was a bit of buck passing. We assumed Bitly was down, it said no, and pointed at Level3.
Adapt, a managed hosting firm, also confirmed that the problems were at Level3 in a message yesterday evening. "We can now confirm that the connectivity issues experienced this afternoon have been resolved as of approximately 16:00. We can also confirm that the root cause of the incident was an outage within the Level 3 IP Transit network causing intermittent connectivity to certain destinations," it said. "We have requested a full incident report from Level 3 and on receipt Adapt will release an Affected Service Report."
Level3 admitted to ISPs that an update to Juniper Networks edge routers on its network was to blame.
"Are you experiencing problems with any other websites? We're hearing reports that there are problems with Level 3," tweeted Bitly.
Level3 confirmed that it had problems, but was quick with a solution. "Our technicians worked quickly to bring systems back online," it said in a statement.
"At this time, all connection issues have been resolved, and we are working hard with our equipment vendors to determine the exact cause of the outage and ensure all systems are stable."
Juniper also explained its involvement and response in a statement to its customers. "We are aware of the Juniper BGP edge router issue this morning. A SW fix is already available," it said while directing readers at a customer only URL that we could not access.
Juniper Networks also promised to release a generally available statement later. µ