Status Tracker v0.23
The issue with Vertex AI Search, Recommendation AI has been resolved for all affected users as of Monday, 2024-12-09 21:48 US/Pacific.
Incident began at 2024-12-09 09:30 and ended at 2024-12-09 21:48 (all times are US/Pacific).
Affected products: Cloud Machine Learning, Recommendation AI, Vertex AI Search
We thank you for your patience while we worked on resolving the issue.
Affected locations: Multi-region: eu, Global, Multi-region: us
The issue with Apigee Edge Public Cloud, Apigee Hybrid & Apigee have been resolved for all affected projects as of Monday, 2024-12-09 16:45 US/Pacific.
Incident began at 2024-12-09 13:55 and ended at 2024-12-09 17:01 (all times are US/Pacific).
Affected products: Apigee, Apigee Edge Public Cloud, Apigee Hybrid
We thank you for your patience while we worked on resolving the issue.
Affected locations: Global, Iowa (us-central1), South Carolina (us-east1), Northern Virginia (us-east4), Columbus (us-east5), Dallas (us-south1), Oregon (us-west1), Los Angeles (us-west2), Salt Lake City (us-west3), Las Vegas (us-west4)
Incident began at 2024-12-09 13:00 and ended at 2024-12-09 15:00 (all times are US/Pacific).
Tests are running now for all form factors (iOS and Android virtual, Arm, physical). Customers may still see some higher wait times for iOS devices.
Affected products: Test Lab
Dec 9, 20:48 UTC
Resolved – This incident has been resolved.
Dec 9, 19:28 UTC
Monitoring – A fix has been implemented and we are monitoring the results.
Dec 9, 16:28 UTC
Investigating – We are currently investigating this issue.
Dec 9, 15:00 EST
Resolved – Our systems are functional and we are closing out this incident.
Dec 9, 14:38 EST
Investigating – We are investigating reports of issues with our systems.
Dec 9, 14:30 EST
Resolved – Our systems are functional and we are closing out this incident.
Dec 9, 13:49 EST
Investigating – We are investigating reports of issues with our systems.
Dec 9, 07:43 PST
Resolved – Between 10:57 AM UTC and 2:00 PM UTC, customers experienced failures when triggering Sub-Zaps, accompanied by the error message: “The app returned ‘You do not have permission to perform this action.'”
The underlying issue was identified and corrected by 2:00 PM UTC. All affected Zap runs have been successfully replayed, ensuring workflows are restored without customer intervention. Thank you for your patience as our team worked to resolve this.
If you have additional questions, please contact our support team at https://zapier.com/app/get-help.
Dec 9, 04:18 PST
Identified – Customers are experiencing failures with their Zaps when triggering sub-Zaps. The error message displayed is:
“The app returned ‘You do not have permission to perform this action.’”
This issue occurs even when customers own both the main Zap and the sub-Zap, suggesting the error is not related to actual permission settings. It is affecting multiple Zaps and disrupting workflows. Investigation into the root cause is ongoing.
Dec 9, 07:23 PST
Resolved – Between 05:19AM and 07:05AM PST, some ChatGPT Enterprise features had degraded performance. The impact comprised of slow logins and degradation in performance of the Workspace Analytics tab, the Members tab, and the Compliance API. We have now mitigated the issue and recovered.
Dec 9, 07:10 PST
Monitoring – Error rates have once again returned to normal. We’re monitoring closely.
Dec 9, 06:56 PST
Update – We’re continuing to work on a resolution for this issue. In the meantime, users will still experience disruption to the previously mentioned features of ChatGPT Enterprise.
Dec 9, 06:20 PST
Identified – Unfortunately, performance on Workspace Analytics, the Compliance API, and Members tab has become degraded again. We’re working to restore normal performance.
Dec 9, 06:05 PST
Monitoring – We’re now recovered as of 05:44am PST. Login, Workplace Analytics, the Compliance API, and the Members tab for ChatGPT Enterprise are now all functioning as normal. We’re continuing to monitor.
Dec 9, 05:50 PST
Identified – We’ve identified the root cause and have begun mitigation. We’re observing an improvement in performance.
Dec 9, 05:42 PST
Investigating – We’re aware of some disruption to ChatGPT Enterprise. Users may experience slowness during login. We are also investigating degraded performance on Workspace Analytics, the Compliance API, and the Members tab. Issues began at 05:19AM PST.
Dec 9, 00:18 PST
Resolved – Our team has deployed the fix and now the system is fully operational.
Dec 8, 22:25 PST
Identified – We have identified the root cause and working on a fix. We will provide more updates as and when they become available.
Dec 8, 19:51 PST
Investigating – Some Notion guests are currently experiencing issues accessing pages. Our engineering team has been notified and is actively working to resolve this issue. We will provide updates as soon as they become available.