Day: November 18, 2024

Medium – Service Interuption

by

Nov 18, 14:53 PST
Resolved – This incident has been resolved.

Nov 18, 14:48 PST
Investigating – Some users are experiencing problems accessing Medium, our team is aware and investigating.

Zapier – Timeout errors related to “by Zapier” apps

by

Nov 18, 12:07 PST
Resolved – From Friday, Nov. 15, 10:50 AM UTC, to Saturday, Nov. 16, 10:33 PM UTC, “by Zapier” apps (like Sub-Zap, Delay, Formatter, and Storage) experienced timeout errors.

If Autoreplay was enabled on your Zap, these timeout errors may have resolved themselves. Our team has now replayed all affected Zap runs, so you should no longer see any errors.

If you’re still encountering an error, we recommend manually replaying the Zap runs: https://zpr.io/jpDSZb3EWUz6.

Thank you for your patience while we resolved this issue. If you have any further questions, please contact our support team: https://zapier.com/app/get-help.

Nov 18, 10:01 PST
Monitoring – On Friday, we saw the start of an issue where timeouts were occurring in Delay, Sub-Zap, and Formatter steps.

Our teams have identified the cause, and we have been working on replaying any runs we can that have seen this issue.

As some customers have seen success in this process, If you see any runs returning a timeout error, we advise to try and replay those runs: https://zpr.io/jpDSZb3EWUz6

We should have more soon on this resolution, and we’re monitoring to see if any other issues reoccur.

If you do see any issues past that though, please don’t hesitate to contact our support team at https://zapier.com/app/get-help.

Nov 15, 15:40 PST
Identified – We believe we have located the cause of that, and are working with out partners to resolve it as soon as possible.

In the meantime, some users have reported being able to successfully replay these error runs. So if you run into these timeout errors on Delay steps and Sub-Zaps, we advise to try and replay those run: https://zpr.io/jpDSZb3EWUz6

Thank you for your patience, and we apologize for any inconvenience.

Nov 15, 13:14 PST
Investigating – We are investigating an issue with timeout errors related to Delay and Sub-Zaps. We apologize for any trouble this is causing, and appreciate your patience and understanding during this time.

GitLab – 500 errors on user preferences pages

by
November 18, 2024 07:02 UTC
Identified – We are seeing a number of 500 errors occurring when users attempt to navigate to the user profile settings in the UI – We have identified the issue and are working on a fix. The issue is being tracked in the incident issue: https://gitlab.com/gitlab-com/gl-infra/production/-/issues/18867

November 18, 2024 07:18 UTC
Identified – A fix has been implemented and is being tested before being merged. For more information please see: https://gitlab.com/gitlab-com/gl-infra/production/-/issues/18867

November 18, 2024 07:34 UTC
Identified – A fix has been merged and it will be deployed shortly – once it has been deployed we will monitor the number of 500s occurring on the settings page to ensure the issue is resolved. For more information please see: https://gitlab.com/gitlab-com/gl-infra/production/-/issues/18867

November 18, 2024 07:57 UTC
Identified – The fix is awaiting deployment, which is expected to occur before 12:00 UTC. Once the fix has deployed the User Preferences page will be monitored to ensure the issue has been resolved. For more information please see: https://gitlab.com/gitlab-com/gl-infra/production/-/issues/18867

November 18, 2024 09:24 UTC
Identified – A fix is currently being deployed and is expected to complete in the next ~3 hours. Another update will be provided at 12:00 UTC or once the deployment has completed. For more information please see: https://gitlab.com/gitlab-com/gl-infra/production/-/issues/18867

November 18, 2024 11:58 UTC
Identified – The deployment process to resolve the issue is still ongoing. We will confirm once the deployment is complete or provide another progress update within ~1 hour. For more information please see: https://gitlab.com/gitlab-com/gl-infra/production/-/issues/18867

November 18, 2024 13:16 UTC
Identified – We have deployed on canary and the revert fixed the issue with accessing the User Preferences page. We will confirm once deployment to production is complete within the next ~40 minutes. For more information please see: https://gitlab.com/gitlab-com/gl-infra/production/-/issues/18867

November 18, 2024 14:07 UTC
Identified – Deployment to production is currently ongoing, but is expected to complete shortly. We will provide another update once deployment is completed. For more information please see: https://gitlab.com/gitlab-com/gl-infra/production/-/issues/18867

November 18, 2024 15:18 UTC
Monitoring – The fix has been deployed to production and the User Preferences page should be accessible again. We’re now monitoring to ensure the issue has been resolved. For more information please see: https://gitlab.com/gitlab-com/gl-infra/production/-/issues/18867

November 18, 2024 15:45 UTC
Resolved – This incident has been resolved as we are no longer seeing any issues on the User Preferences page after a period of monitoring. For more information please see: https://gitlab.com/gitlab-com/gl-infra/production/-/issues/18867