Overnight outage
Incident Report for FMX System
Resolved
Our Cloud Service Provider, Microsoft Azure, has a bug in their service that caused an outage from 11:30 PM EST to 3:30 AM EST. We were delayed in resolving the issue, due to the lateness of the hour and the manual nature of the fix. We are now working on automating the recovery process that Azure has advised us on so that any future incidents of this problem will recover automatically.
Azure is in the process of preparing their permanent fix for this bug for deployment. We are continuing to work with them on any possible escalations to their deployment process. We will update our status page once we have confirmed that Azure's fix was deployed. We deeply apologize for the inconvenience.
Posted Sep 30, 2022 - 23:30 EDT