Customers are unable to edit pages

SUMMARY

On September 15, 2023, between 1:39 and 5:12 UTC, we experienced an issue with a third-party tool that functions as our internal artifact management system. Although the incident was detected within one minute by our monitoring system, this issue led to the degradation of the scaling capabilities of our internal hosting platform, resulting in service degradation or outages for customers of Atlassian cloud products.

IMPACT

This incident affected multiple regions and products, due to the diminished scaling capabilities of our internal hosting platform. Customers using Atlassian cloud products faced reduced functionality, slower response times, and limited access to specific features.

ROOT CAUSE

The root cause of this incident was unexpected behavior in a third-party tool that functions as our internal artifact management system. The issue made it impossible for our artifact management system to scale to demand, and as a result, our internal hosting platform was unable to scale effectively.

Upon identifying and localizing the problem, we corrected the issue and were able to restore full scaling capabilities to our artifact management system, and by extension, our internal hosting platform.

REMEDIAL ACTIONS PLAN & NEXT STEPS

Following a previous incident of this nature (https://jira-software.status.atlassian.com/incidents/pqltf5m971qf), we prioritized a project to ensure that such downtime does not negatively impact the ability to scale for our other components nor cause customer impact. While this work is now complete, it was not quite ready at the time this incident occurred.

Further, we committed to a temporary freeze on non-critical upgrades and changes for the artifact management system. This freeze has been maintained - the issue in this instance was not the result of a change or upgrade, but rather an unforeseen behavior in the system.

We apologize for any inconvenience caused by this incident and appreciate your understanding. Our team is dedicated to continually improving our systems and processes to provide you with the exceptional service you deserve. Thank you for your continued support and trust in us.

Thanks,

Atlassian Customer Support