[OCIO_CUCM] FW: Trouble

[Cheryl Dearborn]

FYI, all this is the latest update from CenturyLink regarding their outage affecting State services.  Unfortunately there is still no estimated time to repair.  But, as soon as we get additional information or updates on the outage we will update everyone!  Thank you.

From: Teater, Martin <Martin.Teater at CenturyLink.com>
Sent: Thursday, December 27, 2018 3:17 PM
To: Cheryl Dearborn <Cheryl.Dearborn at its.idaho.gov>
Cc: Wade Douglass <Wade.Douglass at its.idaho.gov>; Zaine Tarpo <Zaine.Tarpo at its.idaho.gov>
Subject: Re: Trouble

CenturyLink efforts to regain visibility to sites remain ongoing.
Marty T

On Dec 27, 2018, at 12:39 PM, Teater, Martin <Martin.Teater at centurylink.com<mailto:Martin.Teater at centurylink.com>> wrote:
Additional update and details


On December 27, 2018 at 02:40 GMT, CenturyLink identified a service impact in New Orleans, LA. The NOC is engaged and investigating in order to isolate the cause. Field Operations were engaged and dispatched for additional investigations. Tier IV Equipment Vendor Support was later engaged. During cooperative troubleshooting a device in San Antonio, TX was isolated from the network as it was seeming to broadcast traffic consuming capacity, which seemed to alleviate some impact. Investigations remained ongoing. Following the isolation of the San Antonio, TX device troubleshooting efforts focused on additional sites that teams were remotely unable to troubleshoot. Field Operations were dispatched to sites in Kansas City, MO, Atlanta, GA, New Orleans, LA and Chicago, IL. Tier IV Equipment Vendor Support continued to investigate the equipment logs to further assist with isolation. Once visibility was restored to the site in Kansas City, MO a filter was applied to the equipment to further alleviate the impact observed. All of the necessary troubleshooting teams in cooperation with Tier IV Equipment Vendor Support are working to restore remote visibility to the remaining sites at this time. We understand how important these services are to our clients and the issue has been escalated to the highest levels within CenturyLink Service Assurance Leadership.

Marty T

On Dec 27, 2018, at 10:54 AM, Teater, Martin <Martin.Teater at centurylink.com<mailto:Martin.Teater at centurylink.com>> wrote:
Here is the latest update :

Tier IV Technical Support continues to work with all of the necessary troubleshooting teams to further alleviate the issue being experienced.  Field Operations have arrived at multiple sites including Kansas City, MO and New Orleans, LA to assist with the investigations.  Resolution efforts are currently ongoing with the necessary teams investigating equipment in Kansas City, MO and New Orleans, LA.  Field Operations have been dispatched to the site in Atlanta, GA as remote access to the equipment was been lost.

Marty T

On Dec 27, 2018, at 7:11 AM, Cheryl Dearborn <Cheryl.Dearborn at its.idaho.gov<mailto:Cheryl.Dearborn at its.idaho.gov>> wrote:
sip outage? we appear to be down. i

Get Outlook for iOS<https://aka.ms/o0ukef>
This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://admws.idaho.gov/pipermail/ocio_cucm/attachments/20181227/c5d20e03/attachment.html>