Resolved -
The data has been fully resynced to the affected instances, the User Data Synchronization and Onboarding services have been re-enabled and all pending customer aggregations that were queued during this time have completed.
Exclaimer Engineers will continue to monitor the health of the service and the impact to customers has been resolved.
Nov 14, 16:24 UTC
Update -
Microsoft have completed the mitigative steps that were affecting our storage components in East US and the affected storage is healthy once again.
Exclaimer Engineers are now resyncing the data to the affected storage instances. This will take some time as we are partially limited by the capacity contraints ongoing in the East US Azure datacenter.
Once complete, the User Data Synchronization and Onboarding services will be re-enabled and any customer aggregations that have been queued during this time will complete.
Next update to follow in 90 minutes or sooner.
Nov 14, 15:37 UTC
Update -
We are continuing to work with Engineers at Microsoft who have confirmed that mitigative steps required to resolve the issues affecting our storage components in East US which is currently resource constrained has been approved.
As soon as this the allocation is complete, Exclaimer Engineers will be able to proceed with the steps required to fully restore User Data Synchronization and Onboarding services.
Any customers that have attempted to synchronize their data will catch up once this has been completed as the operation is queued internally within Exclaimer's systems.
Next update to follow in 60 minutes
Nov 14, 14:36 UTC
Update -
Exclaimer Engineers are continuing to work with Microsoft on resolving the issues with the storage components affecting onboarding and aggregation in the US.
Microsoft is prioritising our request to make the adjustments required available to us so that we can restore operations fully.
Next update to follow in 60 minutes
Nov 14, 13:27 UTC
Identified -
Exclaimer Engineers are engaged in an issue with some storage components in US that are being impacted by a resource availability shortage in the east us Azure Datacenter.
Currently, customers onboarding or running on-demand data crawls will notice a delay in this data being collected.
Exclaimer Engineers are engaged with Microsoft to mitigate the capacity issues and return the system to normal.
Customer mailflow is not impacted.
Next update within 60 minutes or sooner
Nov 14, 12:22 UTC