AZNet II Engineering has confirmed all AZNet II managed data services and AZNet II Call Processing servers have recovered 100% from the power loss. The AZNet II Engineering is validating the monitoring system. AZNet II has been validating all AZNet II managed agencies connection during this time period . All AZNet II connections for the Phoenix State Data Center are functioning properly.
Technical Conference bridgeline is now closed.
AZNET II Engineering has confirmed all AZNET II managed Data Services have recovered from the power loss. The AZNET II Engineering team is still verfiying some AZNET II Call Processing Servers, as well as, the AZNET II monitoring system.
***********
All affected state agencies except for the Department of Racing have been made aware of the Outage. Our teams are currently working on the issue to restore services as soon as possible.
Affected Agencies: Department of Education, Department of Racing, Govenor's Office of Highway Safety, Department of Gaming, Arizona Children's Association, Registar of Contractors and Department of Revenue have been identified.
At this time we do not have a ETA and apologize for the inconvenience. We will provide an update when available.
You can also call into our Technical Conference line at: 602-771-9091.
We are currently experiencing WAN Network related issues affecting several State Agencies. Our teams are currently working on the issue to restore services as soon as possible.
Affected Agencies: Department of Education, Department of Racing, Govenor's Office of Highway Safety, Department of Gaming, Arizona Children's Association, Registar of Contractors and Department of Revenue have been identified.
At this time we do not have a ETA and apologize for the inconvenience. We will provide an update when available.
You can also call into our Technical Conference line at: 602-771-9091.
We are currently experiencing WAN Network related issues affecting several State Agencies. Our teams are currently working on the issue to restore services as soon as possible.
Affected Agencies: Department of Education, Department of Racing, Govenor's Office of Highway Safety have been identified.
At this time we do not have a ETA and apologize for the inconvenience. We will provide an update when available.
We are currently experiencing technical issues affecting Openbooks production and Administrative environments. Our teams are currently working on the issue to restore services as soon as possible.
At this time we do not have a ETA and apologize for the inconvenience. We will provide an update when available.
Please reference ticket numbers: Incident 68660
We are currently experiencing technical issues affecting the CIO Sharepoint website (https://cio.az.gov). Our teams are currently working on the issue to restore services as soon as possible.
At this time we do not have a ETA and apologize for the inconvenience. We will provide another update when available.
Please reference ticket number: Incident 67427
Carrier Services have been restored for all State provided Voice Services as of 10:28 AM.
We apologize for any inconvenience this may have caused. The Carrier will continue to monitor for any future occurrences.
If you encounter any issues with your Telecommunications service, please contact the AZNET Support Desk at (602) 364-4444, option 1 to have an AZNET ticket submitted for your request.
Thank you for your continued partnership
We are currently experiencing Carrier issues servicing the state Data services, impacting a large number of Users and Call Centers. The Carrier is in process of troubleshooting at their Carrier Central Office.
At this time we do not have an ETA and apologize for the inconvenience. We will provide an update when available.
Please reference this ticket: Remedy 57218
We are currently experiencing technical issues affecting the Department of Health Services - Medical Marijuana Program application. Our teams are currently working on the issue to restore services as soon as possible.
At this time we do not have a ETA and apologize for the inconvenience. We will provide another update when available.
Please reference ticket number: Incident 66465
Services have been restored for the Microsoft SharePoint websites as of 3:49 PM.
We apologize for any inconvenience this may have caused.
If you encounter any issue with the application, please contact the ADOA Service Desk at (602) 364-4444, option 3.
We are currently experiencing technical issues affecting ADOA SharePoint websites. Our teams are currently working on the issue to restore services as soon as possible.
We currently do not have an ETA and apologize for the inconvenience. We will provide another update when available.
Please reference ticket numbers: Incident 61799 when calling the ADOA Service desk at (602) 364-4444, option 3.
Services have been restored for the Microsoft Lync application as of 11:14 PM UTC.
=======snip========
|
Jun 23, 2014 5:24 PM |
Service restored |
Closure Summary: On Monday, June 23, 2014, at approximately 3:30 PM UTC, engineers received reports of an issue in which some customers were unable to sign in to the Lync Online service. Investigation determined that network traffic routing for user connectivity was in a degraded state. At 7:30 PM UTC, engineers re-routed network traffic to alternate capacity, which restored connectivity for a subset of customers. Engineers continued analyzing network traffic to further isolate the source of the issue for the remaining affected customers, and identified an additional degraded portion of network infrastructure that was preventing connections from being routed successfully. Engineers implemented a configuration change to bypass the affected network infrastructure to restore service. The issue was successfully fixed on Monday, June 23, 2014, at 11:14 PM UTC. A post-incident report will be available on the Service Health Dashboard within five business days. |
============snip===========
We apologize for any inconvenience this may have caused.
If you encounter any issue with the application, please contact the ADOA Service Desk at (602) 364-4444, option 3.
We are currently experiencing technical issues affecting the Microsoft Lync application. The Office 365 teams are currently working on the issue to restore services as soon as possible.
At this time we received the following update from Microsoft Office 365 support:
=======snip=========
|
Jun 23, 2014 4:38 PM |
Restoring service |
Current Status: Further analysis of network traffic identified an additional portion of network infrastructure that was causing a degradation in routing of user connections. Engineers are implementing a configuration change to bypass the affected infrastructure and restore user connectivity. |
============snip===========
We currently do not have an ETA and apologize for the inconvenience. We will provide another update when available.
Please reference ticket number: Incident 61522 when calling the ADOA Service Desk at (602) 364-4444, option 3.
We are currently experiencing technical issues affecting the Microsoft Lync application. The Office 365 teams are currently working on the issue to restore services as soon as possible.
At this time we received the following update from Microsoft Office 365 support:
==========snip============
|
Jun 23, 2014 3:28 PM |
Restoring service |
Current Status: Engineers are capturing additional data on network traffic and conducting a detailed analysis to determine the underlying root cause of the issue affecting the remaining tenants. Engineers are taking every possible action to resolve this issue as quickly as possible. |
============snip===============
We currently do not have an ETA and apologize for the inconvenience. We will provide another update when available.
Please reference ticket number: Incident 61522 when calling the ADOA Service Desk at (602) 364-4444, option 3.
We are currently experiencing technical issues affecting the Microsoft Lync application. Our teams are currently working on the issue to restore services as soon as possible.
At this time we received the following update from Microsoft Office 365 support:
=======snip===========
|
Jun 23, 2014 2:35 PM |
Restoring service |
Current Status: The associated voicemail issue has been resolved. Engineers are continuing their efforts to resolve the login issues for the remaining customers as soon as possible. |
============snip===============
We currently do not have an ETA and apologize for the inconvenience. We will provide another update when available.
Please reference ticket number: Incident 61522 when calling the ADOA Service Desk at (602) 364-4444, option 3.
We are currently experiencing technical issues affecting the Microsoft Lync application. Our teams are currently working on the issue to restore services as soon as possible.
At this time we received the following update from Microsoft Office 365 support:
==========snip===========
|
Jun 23, 2014 11:31 AM |
Restoring service |
Current Status: As previous mitigation steps have not been fully effective in restoring service, engineers are now working to shift network traffic to an alternate datacenter facility. Affected customers are likely to experience intermittent connection errors and reduced functionality as this process is completed. |
==============snip================
We currently do not have an ETA and apologize for the inconvenience. We will provide another update when available.
Please reference ticket numbers: Incident 61522
Services have been restored for the Department of Health Services - Medical Marijuana program application as of 11:41AM.
We apologize for any inconvenience this may have caused.
If you encounter any issue with the application, please contact the ADOA Service Desk at (602) 364-4444, option 5.
We are currently experiencing technical issues affecting the Department of Health Services - Medical Marijuana Program application. Our teams are currently working on the issue to restore services as soon as possible.
At this time we do not have a ETA and apologize for the inconvenience. We will provide another update when available.
Please reference ticket numbers: Incident 61365
We are currently experiencing technical issues affecting the Department of Health Services - Medical Marijuana Program application. Our teams are currently working on the issue to restore services as soon as possible.
At this time we do not have a ETA and apologize for the inconvenience. We will provide another update at 11:30 AM.
Please reference ticket numbers: Incident 61365
Voice Services have been restored for all State provided Voice Services as of 5:23 PM.
We apologize for any inconvenience this may have caused. The Carrier will continue to monitor for any future occurrences.
If you encounter any issues with your Telecommunications service, please contact the AZNET Support Desk at (602) 364-4444, option 1 to have an AZNET ticket submitted for your request.
Thank you for your continued partnership