Vercel – SSL Certificate Generation Delays

Dec 12, 14:13 UTC
Resolved – This incident has been resolved.

Dec 12, 13:36 UTC
Monitoring – A fix has been implemented and we are monitoring the results.

Dec 12, 12:39 UTC
Identified – The issue has been identified and a fix is being implemented.

Dec 12, 12:11 UTC
Investigating – We are currently investigating reports of delays in generating SSL certificates. We will provide a further update once available.

Cloudflare – LAX (Los Angeles) on 2024-12-12

Dec 12, 09:00 UTC
In progress – Scheduled maintenance is currently in progress. We will provide updates as necessary.

Dec 12, 12:00 UTC
Completed – The scheduled maintenance has been completed.

Dec 10, 17:20 UTC
Update – We will be performing scheduled maintenance in LAX (Los Angeles) datacenter on 2024-12-12 between 09:00 and 22:00 UTC.

Traffic might be re-routed from this location, hence there is a possibility of a slight increase in latency during this maintenance window for end-users in the affected region. For PNI / CNI customers connecting with us in this location, please make sure you are expecting this traffic to fail over elsewhere during this maintenance window as network interfaces in this datacentre may become temporarily unavailable.

You can now subscribe to these notifications via Cloudflare dashboard and receive these updates directly via email, PagerDuty and webhooks (based on your plan): https://developers.cloudflare.com/notifications/notification-available/#cloudflare-status.

Dec 10, 21:48 UTC
Update – We will be performing scheduled maintenance in LAX (Los Angeles) datacenter on 2024-12-12 between 09:00 and 12:00 UTC.

Traffic might be re-routed from this location, hence there is a possibility of a slight increase in latency during this maintenance window for end-users in the affected region. For PNI / CNI customers connecting with us in this location, please make sure you are expecting this traffic to fail over elsewhere during this maintenance window as network interfaces in this datacentre may become temporarily unavailable.

You can now subscribe to these notifications via Cloudflare dashboard and receive these updates directly via email, PagerDuty and webhooks (based on your plan): https://developers.cloudflare.com/notifications/notification-available/#cloudflare-status.

Dec 10, 00:16 UTC
Update – We will be performing scheduled maintenance in LAX (Los Angeles) datacenter on 2024-12-12 between 09:00 and 14:00 UTC.

Traffic might be re-routed from this location, hence there is a possibility of a slight increase in latency during this maintenance window for end-users in the affected region. For PNI / CNI customers connecting with us in this location, please make sure you are expecting this traffic to fail over elsewhere during this maintenance window as network interfaces in this datacentre may become temporarily unavailable.

You can now subscribe to these notifications via Cloudflare dashboard and receive these updates directly via email, PagerDuty and webhooks (based on your plan): https://developers.cloudflare.com/notifications/notification-available/#cloudflare-status.

Dec 10, 00:18 UTC
Update – We will be performing scheduled maintenance in LAX (Los Angeles) datacenter on 2024-12-12 between 09:00 and 15:00 UTC.

Traffic might be re-routed from this location, hence there is a possibility of a slight increase in latency during this maintenance window for end-users in the affected region. For PNI / CNI customers connecting with us in this location, please make sure you are expecting this traffic to fail over elsewhere during this maintenance window as network interfaces in this datacentre may become temporarily unavailable.

You can now subscribe to these notifications via Cloudflare dashboard and receive these updates directly via email, PagerDuty and webhooks (based on your plan): https://developers.cloudflare.com/notifications/notification-available/#cloudflare-status.

Dec 6, 17:53 UTC
Scheduled – We will be performing scheduled maintenance in LAX (Los Angeles) datacenter on 2024-12-12 between 09:00 and 12:00 UTC.

Traffic might be re-routed from this location, hence there is a possibility of a slight increase in latency during this maintenance window for end-users in the affected region. For PNI / CNI customers connecting with us in this location, please make sure you are expecting this traffic to fail over elsewhere during this maintenance window as network interfaces in this datacentre may become temporarily unavailable.

You can now subscribe to these notifications via Cloudflare dashboard and receive these updates directly via email, PagerDuty and webhooks (based on your plan): https://developers.cloudflare.com/notifications/notification-available/#cloudflare-status.

OpenAI – Login errors on ChatGPT and the API Playground

Dec 12, 03:19 PST
Resolved – Between 01:55AM and 02:53AM PST we experienced some disruption to our service. The primary impact was that users were not able to login to ChatGPT or the API Playground. Some other requests may have been affected.

Dec 12, 02:57 PST
Monitoring – We’ve implemented a fix and are monitoring the impact.

Dec 12, 02:40 PST
Investigating – We are currently investigating some disruption to ChatGPT and the API.

Jira Product Discovery – Errors on AI features

Dec 12, 08:37 UTC
Resolved – Between 3:16pm PST and 7:38pm PST, we experienced an outage for Rovo and all AI features across Atlassian Products. The issue has been resolved and the service is operating normally

Dec 12, 03:50 UTC
Update – We are witnessing significant recovery in the services. We will continue to monitor the situation closely.

Dec 12, 03:03 UTC
Investigating – We are actively communicating with the affected AI Service provider and closely monitoring the ongoing outage situation. While we have observed some signs of recovery, the majority of API calls are still resulting in errors.

We have successfully restored the Smart Answers in Search feature by rerouting requests to an alternative model.

All other Atlassian Intelligence capabilities and Rovo remain unavailable at this time due to the ongoing AI Service provider outage.

Jira Service Management – Errors on AI features

Dec 12, 08:37 UTC
Resolved – Between 3:16pm PST and 7:38pm PST, we experienced an outage for Rovo and all AI features across Atlassian Products. The issue has been resolved and the service is operating normally

Dec 12, 03:50 UTC
Update – We are witnessing significant recovery in the services. We will continue to monitor the situation closely.

Dec 12, 03:03 UTC
Investigating – We are actively communicating with the affected AI Service provider and closely monitoring the ongoing outage situation. While we have observed some signs of recovery, the majority of API calls are still resulting in errors.

We have successfully restored the Smart Answers in Search feature by rerouting requests to an alternative model.

All other Atlassian Intelligence capabilities and Rovo remain unavailable at this time due to the ongoing AI Service provider outage.

Confluence – Errors on AI features

Dec 12, 08:37 UTC
Resolved – Between 3:16pm PST and 7:38pm PST, we experienced an outage for Rovo and all AI features across Atlassian Products. The issue has been resolved and the service is operating normally

Dec 12, 03:50 UTC
Update – We are witnessing significant recovery in the services. We will continue to monitor the situation closely.

Dec 12, 03:03 UTC
Investigating – We are actively communicating with the affected AI Service provider and closely monitoring the ongoing outage situation. While we have observed some signs of recovery, the majority of API calls are still resulting in errors.

We have successfully restored the Smart Answers in Search feature by rerouting requests to an alternative model.

All other Atlassian Intelligence capabilities and Rovo remain unavailable at this time due to the ongoing AI Service provider outage.

Jira – Errors on AI features

Dec 12, 08:37 UTC
Resolved – Between 3:16pm PST and 7:38pm PST, we experienced an outage for Rovo and all AI features across Atlassian Products. The issue has been resolved and the service is operating normally

Dec 12, 03:50 UTC
Update – We are witnessing significant recovery in the services. We will continue to monitor the situation closely.

Dec 12, 03:03 UTC
Investigating – We are actively communicating with the affected AI Service provider and closely monitoring the ongoing outage situation. While we have observed some signs of recovery, the majority of API calls are still resulting in errors.

We have successfully restored the Smart Answers in Search feature by rerouting requests to an alternative model.

All other Atlassian Intelligence capabilities and Rovo remain unavailable at this time due to the ongoing AI Service provider outage.

Rovo – OpenAI’s API is returning 5xx for GPT models

Dec 12, 07:26 UTC
Resolved – Between 3:16pm PST and 7:38pm PST, we experienced an outage for Rovo and all AI features across Atlassian Products. The issue has been resolved and the service is operating normally.

Dec 12, 03:50 UTC
Update – We are witnessing significant recovery of the services. We will continue to monitor the situation closely.

Dec 12, 02:35 UTC
Update – We are actively communicating with the affected AI Service provider and closely monitoring the ongoing outage situation. While we have observed some signs of recovery, the majority of API calls are still resulting in errors.

We have successfully restored the Smart Answers in Search feature by rerouting requests to an alternative model.

All other Atlassian Intelligence capabilities and Rovo remain unavailable at this time due to the ongoing AI Service provider outage.

Dec 12, 00:47 UTC
Investigating – We have reached out to our AI Service Provider and they are actively working on restoring the API.

Additionally, we are working on routing the traffic for Smart answers in Search capability to another model.

We will provide more details within the next hour.

OpenAI – API, ChatGPT & Sora Facing Issues

Dec 11, 22:23 PST
Resolved – Between 3:16pm PST and 7:38pm PST on December 11, OpenAI’s services were unavailable. We began to see recovery for API traffic starting at approximately 5:40pm PST, and for ChatGPT and Sora around 6:50pm PST. We mitigated the issues at 7:38 pm PST, and all services are now fully operational.

OpenAI will run a full root-cause analysis of this outage and will share details on this page when complete.

Dec 11, 19:53 PST
Monitoring – API, ChatGPT, and Sora traffic has largely recovered. We are monitoring the situation to ensure full resolution.

Dec 11, 18:54 PST
Update – We are continuing to work towards remediation. API traffic recovery is ongoing and we are bringing ChatGPT traffic back up by region. Sora is partially beginning to recover.

Dec 11, 17:50 PST
Update – We are continuing to work towards remediation. API and ChatGPT traffic is partially recovered. Sora remains down.

Dec 11, 17:03 PST
Update – We are continuing to work on a fix for this issue.

Dec 11, 16:59 PST
Update – We are continuing to work on a fix for this issue.

Dec 11, 16:55 PST
Update – We have identified a pathway to recovery and we are starting to see some traffic successfully return. Continuing to work to return service to normal.

Dec 11, 16:24 PST
Update – ChatGPT, Sora, and the API remain down. We have identified the issue and are rolling out a remediation. We are working as fast as we can to return service to normal and apologize for the downtime.

Dec 11, 15:53 PST
Identified – We have reports of API calls returning errors, and difficulties logging in to platform.openai.com and ChatGPT. We have identified the issue and are working to roll out a fix.

Dec 11, 15:45 PST
Update – We are continuing to investigate this issue.

Dec 11, 15:42 PST
Update – We are continuing to investigate this issue.

Dec 11, 15:17 PST
Investigating – We are currently investigating the issue and will provide more updates shortly.