Incident began at 2024-12-12 07:30 and ended at 2024-12-18 11:00 (all times are US/Pacific).
The rollout was complete as of December 18, 2024.
Affected products: Ranking
Status Tracker v0.23
Incident began at 2024-12-12 07:30 and ended at 2024-12-18 11:00 (all times are US/Pacific).
The rollout was complete as of December 18, 2024.
Affected products: Ranking
Dec 19, 00:30 UTC
In progress – Scheduled maintenance is currently in progress. We will provide updates as necessary.
Dec 19, 09:00 UTC
Completed – The scheduled maintenance has been completed.
Dec 18, 08:18 UTC
Scheduled – We will be performing scheduled maintenance in ZRH (Zurich) datacenter on 2024-12-19 between 00:30 and 09:00 UTC.
Traffic might be re-routed from this location, hence there is a possibility of a slight increase in latency during this maintenance window for end-users in the affected region. For PNI / CNI customers connecting with us in this location, please make sure you are expecting this traffic to fail over elsewhere during this maintenance window as network interfaces in this datacentre may become temporarily unavailable.
You can now subscribe to these notifications via Cloudflare dashboard and receive these updates directly via email, PagerDuty and webhooks (based on your plan): https://developers.cloudflare.com/notifications/notification-available/#cloudflare-status.
Dec 19, 07:24 UTC
Investigating – Cloudflare is investigating an issue where users may experience issues creating new Worker Routes or modifying Worker Routes from the Dashboard.
We are working to analyse and mitigate this problem. More updates to follow shortly.
Dec 19, 02:07 EST
Resolved – Our systems are functional and we are closing out this incident.
Dec 19, 02:01 EST
Investigating – We are investigating reports of issues with our systems.
Dec 19, 02:01 EST
Resolved – Our systems are functional and we are closing out this incident.
Dec 19, 01:57 EST
Investigating – We are investigating reports of issues with our systems.
THIS IS A SCHEDULED EVENT Dec 19, 07:00 – 13:00 UTC
Dec 16, 02:38 UTC
Scheduled – We will be performing scheduled maintenance in MIA (Miami) datacenter on 2024-12-19 between 07:00 and 13:00 UTC.
Traffic might be re-routed from this location, hence there is a possibility of a slight increase in latency during this maintenance window for end-users in the affected region. For PNI / CNI customers connecting with us in this location, please make sure you are expecting this traffic to fail over elsewhere during this maintenance window as network interfaces in this datacentre may become temporarily unavailable.
You can now subscribe to these notifications via Cloudflare dashboard and receive these updates directly via email, PagerDuty and webhooks (based on your plan): https://developers.cloudflare.com/notifications/notification-available/#cloudflare-status.
Dec 19, 06:57 UTC
Resolved – Between 19-Dec 00:30 UTC – 06:22 UTC, some users can’t load Jira issue view (full issue view) pages. This has now been fixed and services are now operating normally.
Dec 19, 01:48 EST
Resolved – Our systems are functional and we are closing out this incident.
Dec 19, 01:42 EST
Investigating – We are investigating reports of issues with our systems.
Dec 19, 06:06 UTC
Resolved – Between 19-Dec 03:38 UTC and 05:38 UTC, some customers were unable to edit or see the description for specific issue type bug. The editor wasn’t visible when trying to add new comments. This has now been mitigated and we’ve seen recovery. Services are now back to normal operations.
Dec 19, 05:03 UTC
Resolved – From 1:23 UTC to 3:04 UTC, users may have experienced issues with events being stuck or delayed, such as powering on/off, and resizing Droplets in the NYC3, AMS2, BLR1, SGP1, and SYD1 regions. Additionally, Managed Database creates were delayed in all regions.
Our Engineering team has confirmed full resolution of the issue, delayed events and new events should complete as normal now.
Thank you for your patience through this issue. If you continue to experience any issues, please open a support ticket from within your account.
Dec 19, 04:28 UTC
Update – Our Engineering team has confirmed that new events are succeeding, and we’re finalizing cleaning up any stalled events. We will post an update as soon this issue is fully resolved.
Dec 19, 03:08 UTC
Monitoring – Events in NYC3 has been enabled now and users may continue to submit new events. We are starting to see success rates with event processing go up.
We will post another update soon. Thank you for your patience.
Dec 19, 02:42 UTC
Update – Our Engineering team continues to work to mitigate the issue with event processing in multiple regions.
To help address the issue, we are temporarily disabling all Droplet-related actions in the NYC3 region for a period of 20 minutes. During this time, users in NYC3 will not be able to submit actions, such as creating, resizing, powering on/off, etc.
We apologize for the inconvenience and appreciate your patience as we work to resolve this issue. Further updates will be shared as they become available.
Dec 19, 01:45 UTC
Investigating – Our Engineering team is investigating an issue impacting Droplet event processing in multiple regions.
At this time, users may experience issues with events appearing to be stuck or delayed, such as powering on/off, and resizing Droplets in NYC3, AMS2, BLR1, SGP1, and SYD1 regions. Additionally, Managed Database creates are delayed in all regions.
We apologize for the inconvenience and will share an update once we have more information.