Day: January 7, 2025

Google Cloud – RESOLVED: Elevated rate of ‘500’ errors observed on Gemini 1.5 Flash and Gemini 1.5 Pro 002

by

Incident began at 2025-01-07 13:28 and ended at 2025-01-07 21:18 (all times are US/Pacific).

The issue with Vertex Gemini API has been resolved for all affected users as of Tuesday, 2025-01-07 21:18 US/Pacific.

We thank you for your patience while we worked on resolving the issue.

Affected products: Vertex Gemini API

Affected locations: Taiwan (asia-east1), Hong Kong (asia-east2), Tokyo (asia-northeast1), Seoul (asia-northeast3), Mumbai (asia-south1), Singapore (asia-southeast1), Sydney (australia-southeast1), Warsaw (europe-central2), Finland (europe-north1), Madrid (europe-southwest1), Belgium (europe-west1), London (europe-west2), Frankfurt (europe-west3), Netherlands (europe-west4), Zurich (europe-west6), Milan (europe-west8), Paris (europe-west9), Doha (me-central1), Dammam (me-central2), Tel Aviv (me-west1), Montréal (northamerica-northeast1), São Paulo (southamerica-east1), Iowa (us-central1), South Carolina (us-east1), Northern Virginia (us-east4), Columbus (us-east5), Dallas (us-south1), Oregon (us-west1), Las Vegas (us-west4)

Instructure – Some users are experiencing connection errors when accessing Canvas.

by

Jan 7, 20:10 MST
Monitoring – A fix has been implemented and we are monitoring the results.

Jan 7, 20:16 MST
Resolved – This incident has been resolved.

Jan 7, 19:55 MST
Identified – The issue has been identified and a fix is being implemented.

Jan 7, 19:59 MST
Update – We are continuing to work on a fix for this issue.

Jan 7, 18:50 MST
Investigating – We are currently investigating this issue.

Jan 7, 19:05 MST
Update – We are continuing to investigate this issue.

Cloudflare – MXP (Milan) on 2025-01-08

by

Dec 30, 11:20 UTC
Scheduled – We will be performing scheduled maintenance in MXP (Milan) datacenter on 2025-01-08 between 01:00 and 06:00 UTC.

Traffic might be re-routed from this location, hence there is a possibility of a slight increase in latency during this maintenance window for end-users in the affected region. For PNI / CNI customers connecting with us in this location, please make sure you are expecting this traffic to fail over elsewhere during this maintenance window as network interfaces in this datacentre may become temporarily unavailable.

You can now subscribe to these notifications via Cloudflare dashboard and receive these updates directly via email, PagerDuty and webhooks (based on your plan): https://developers.cloudflare.com/notifications/notification-available/#cloudflare-status.

THIS IS A SCHEDULED EVENT Jan 8, 2025, 01:00 – 06:00 UTC

Google Cloud – RESOLVED: Some Apigee X customers experienced issues with logging into the integrated developer portals using SAML.

by

Incident began at 2025-01-07 12:51 and ended at 2025-01-07 15:30 (all times are US/Pacific).

The issue with Apigee has been resolved for all affected users as of Tuesday, 2025-01-07 15:22 US/Pacific.

We thank you for your patience while we worked on resolving the issue.

Affected products: Apigee

Affected locations: Taiwan (asia-east1), Hong Kong (asia-east2), Tokyo (asia-northeast1), Osaka (asia-northeast2), Seoul (asia-northeast3), Mumbai (asia-south1), Delhi (asia-south2), Singapore (asia-southeast1), Jakarta (asia-southeast2), Sydney (australia-southeast1), Melbourne (australia-southeast2), Warsaw (europe-central2), Finland (europe-north1), Madrid (europe-southwest1), Belgium (europe-west1), Turin (europe-west12), London (europe-west2), Frankfurt (europe-west3), Netherlands (europe-west4), Zurich (europe-west6), Milan (europe-west8), Paris (europe-west9), Doha (me-central1), Dammam (me-central2), Tel Aviv (me-west1), Montréal (northamerica-northeast1), Toronto (northamerica-northeast2), Mexico (northamerica-south1), São Paulo (southamerica-east1), Santiago (southamerica-west1), Iowa (us-central1), South Carolina (us-east1), Northern Virginia (us-east4), Columbus (us-east5), Dallas (us-south1), Oregon (us-west1), Los Angeles (us-west2), Salt Lake City (us-west3), Las Vegas (us-west4)

HubSpot – HubSpot may be unavailable for some users

by

Jan 7, 16:25 EST
Resolved – HubSpot is now working for all users. We identified and addressed the root cause of the issue that prevented HubSpot from loading, and the issue is fully resolved. No data was lost.

Jan 7, 16:15 EST
Investigating – We’re investigating reports that HubSpot may be unavailable for some users. We’ll update this page when we have more information.