Network Status

[resolved]

[NL] Connectivity issues in part of our network [Update]

Dear LeaseWeb Customer,

We are experiencing issues with one of our Internet Exchanges (AMS-IX).Due to the connectivity issues you might be experiencing latency issues or packet loss to certain external hosts.

In cooperation with AMS-IX NOC department we are looking into this issue, and we will provide an update once more information is available.

[UPDATE 13:20 CEST]

The cause of the issue has been traced to one of the physical connections towards AMS-IX. 
We are working closely with AMS-IX NOC to resolve this issue.

An update will be provided once more information is available.

[UPDATE 13:50 CEST]

Troubleshooting of the physical connection is still ongoing.

An update will be provided once more information is available.

[UPDATE 16:15 CEST]

Troubleshooting of the physical connection is still in progress.

Traffic is being shifted from AMS-IX until the problem is resolved.

[UPDATE 17:50 CEST]

Troubleshooting of the physical connection is still in progress.

Traffic was shifted from one of our ports in AMS-IX. Problems should now be resolved. 

If you are experiencing connectivity issues at this time, please open a ticket via the LeaseWeb Customer Portal, or contact us at support@leaseweb.com.

[UPDATE 21:50 CEST]

Most of the problems reported were resolved when our problematic connection towards AMS-IX was disabled.
Some customers still reported problems, and upon further investigation we concluded that the other AMS-IX connection might be problematic as well.

Announcements to AMS-IX were disabled entirely; We have no incoming traffic from AMS-IX to LeaseWeb at all, and since then remaining problems have disappeared.

We will continue troubleshooting, and request assistance from the AMS-IX NOC in time.

[UPDATE 15:55 CEST]

Troubleshooting performed in co-operation with AMS-IX identified that the root cause was located in the BackBone of AMS-IX; there was an optic that cause packet corruption. After AMS-IX replaced the optic, the problem was resolved. Since then we have tested our links to AMS-IX, and after we verified the problems were no longer present, we gradually restored traffic last night.

Capacity to AMS-IX is now restored. If you are experiencing connectivity issues at this time, please contact our Support Department.

Sincerely, LeaseWeb http://www.leasewebnoc.com Data center naming system is explained here: http://www.leaseweb.com/en/about-us/data-centers

Below, you will find the network status for the LeaseWeb network. If you would like to be notified about network status changes and maintenance windows, you can subscribe to the LeaseWeb NOC mailinglist.