<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"Monotype Corsiva";
panose-1:3 1 1 1 1 2 1 1 1 1;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:668022414;
mso-list-template-ids:731523046;}
@list l0:level1
{mso-level-tab-stop:.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level2
{mso-level-tab-stop:1.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level3
{mso-level-tab-stop:1.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level4
{mso-level-tab-stop:2.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level5
{mso-level-tab-stop:2.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level6
{mso-level-tab-stop:3.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level7
{mso-level-tab-stop:3.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level8
{mso-level-tab-stop:4.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level9
{mso-level-tab-stop:4.5in;
mso-level-number-position:left;
text-indent:-.25in;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">Agency GIS People,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">You might have noticed that Esri had an outage in the AGOL Services on February 28<sup>th</sup>.<o:p></o:p></p>
<p class="MsoNormal">Below is the report from Esri about the outage for your information.<o:p></o:p></p>
<p class="MsoNormal">(sorry for the delay, Esri got me the report in a timely manner, but I was on vacation)<o:p></o:p></p>
<p class="MsoNormal">If you have any questions please let me know.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222">Thank you for your patience as we worked through the ArcGIS Online outage to restore all services, maps and apps. ArcGIS Online is a resilient, well architected system
and events of this type are rare - we have not had an outage like this since 2011. At this point, we are confident that everything is back to normal and no data was lost.<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222"> <o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222">Here is a summary of what happened and what’s planned going forward:<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222"> <o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222">We saw an outage of most </span><a href="http://arcgis.com/" target="_blank"><span style="color:#015BA7">arcgis.com</span></a><span style="color:#222222"> sites and services
between 9:39 am and 12:34pm on February 28, 2017 with lingering issues with our Hosted Tile Services until 4:50pm. The impact was widespread as our primary </span><a href="http://www.arcgis.com/" target="_blank"><span style="color:#015BA7">www.arcgis.com</span></a><span style="color:#222222"> site
was down causing users to be unable to use sites and applications that depend on ArcGIS Online logins and maps.<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222"> <o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222">The root cause was an Amazon Web Services (AWS) S3 outage which was widely experienced across the Internet. Many of you have asked if ArcGIS Online is redundant and the
answer is yes. It is a multi-data center deployment but was impacted because the AWS outage affected the whole US-East-1 region. Because AWS uses S3 within many other services many of the services we rely on were also impacted.<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222"> <o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222">Things we will be working on :<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222">- We already have redundancy and fail over across data centers for our central web site and its content mgt and sharing api that were affected by the outage. The underlying
storage service we rely on from Amazon for this is already replicated across data centers. We will investigate and consider additional improvements that might be made as we receive details on the outage.<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222">- Additional communication channels such as email notification are being considered as an escalation should events like this occur in the future. We want to ensure you
get the message when communication is essential.<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222">- We will continue to work with our partner providers on the details of the root cause of the incident so we can examine our engineering and operational processes.<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222"> <o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222"> <o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222">Additional resources:<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:1.0in;text-indent:-.25in;mso-list:l0 level1 lfo1;background:white">
<![if !supportLists]><span style="color:#222222"><span style="mso-list:Ignore">1.<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span style="color:#222222">Status information about ArcGIS Online services disruptions are updated throughout events, and also serve as a historical availability reference </span><a href="http://status.arcgis.com/" target="_blank"><span style="color:#015BA7">http://status.arcgis.com</span></a><span style="color:#222222">.<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:1.0in;background:white"><span style="color:#222222"> <o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:1.0in;text-indent:-.25in;mso-list:l0 level1 lfo1;background:white">
<![if !supportLists]><span style="color:#222222"><span style="mso-list:Ignore">2.<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span style="color:#222222">Additional information about the Amazon Web Services outage may be found within the Status History February 28th portion of the </span><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__status.aws.amazon.com_&d=DwMFAg&c=n6-cguzQvX_tUIrZOS_4Og&r=AZdr0XWlk6fN6767KnD5zrf5p7tTLe3E5j99KldRjIY&m=lZZAkkk4Jf__oyCkChcFktCmlh3OX2PFmDgh6MB3sfE&s=rSugs6ySBMIVDE3u-2Id0yQ3Dwo1BNyf_h9z_ZGDI3c&e=" target="_blank"><span style="color:#015BA7">http://status.aws.amazon.com</span></a><span style="color:#222222"> website.
The specific response on this from Amazon is here: </span><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__aws.amazon.com_message_41926_&d=DwMFAg&c=n6-cguzQvX_tUIrZOS_4Og&r=AZdr0XWlk6fN6767KnD5zrf5p7tTLe3E5j99KldRjIY&m=lZZAkkk4Jf__oyCkChcFktCmlh3OX2PFmDgh6MB3sfE&s=WYi5AvEzmwTHhGx7bi3Wu-qrF4nYkS44qIxm7GHI5AE&e=" target="_blank"><span style="color:#015BA7">https://aws.amazon.com/message/41926/</span></a><span style="color:#222222"><o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222"> <o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222"> <o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222"> <o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222">Paul Ross<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="color:#222222">Sr. Product Manager, ArcGIS Online<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in;background:white"><a href="mailto:pross@esri.com" target="_blank"><span style="color:#015BA7">pross@esri.com</span></a><span style="color:#222222"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">Cheers,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Monotype Corsiva"">Bill</span><span style="font-size:18.0pt;font-family:"Monotype Corsiva""><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><a href="mailto:bill.farnsworth@cio.idaho.gov"><span style="color:blue">bill.farnsworth@cio.idaho.gov</span></a><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">208 332-1878 (w)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">208 867-5007 (c)<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>