Summary
On Friday, March 20th, BrainStorm experienced a 30-minute service disruption due to a recurrence of a previously identified Microsoft-side encryption key issue first encountered on March 12.
Impact
The BrainStorm platform was unavailable from 7:02 AM to 7:32 AM MDT (30 minutes).
Root Cause
The outage was caused by an issue with Microsoft-managed encryption keys. During a redeployment of the account service, the encryption configuration reverted, triggering the same failure condition observed on March 12. This indicates the underlying issue on the Microsoft side has not yet been fully resolved.
Detection
Automated alerts were triggered immediately when the issue reoccurred, allowing for rapid identification of the problem.
Resolution
The team quickly identified the root cause and restored the correct encryption configuration. Service was fully restored within 30 minutes of the initial outage. Microsoft has been re-engaged and updated on the recurrence of this issue.
Preventive Actions / Next Steps