On May 15, our servers experienced unexpected downtime for approximately 15 minutes due to a misconfiguration in our Continuous Deployment setup. The issue was detected at 11:34 UTC+2 and fully resolved by 11:49 UTC+2.
During this time, services were unavailable for all users. Any attempts to access the application or APIs would have resulted in errors.
Root Cause A recent change in our CD pipeline introduced a misconfiguration that prevented servers from starting correctly after a deployment. This error was not caught during the build phase but manifested during runtime.
Preventative Measures To avoid similar incidents in the future, we are taking the following actions: Additional validation checks are being added to our CD pipeline. Improving automated deployment rollback mechanisms.
We sincerely apologize for the inconvenience this caused and appreciate your patience as we work to make our systems more resilient.
May 15, 11:30 CEST