Past Incidents

Thursday 21st September 2023

Kubernetes Infrastructure Upgrade without outage at zone southamerica-east1-a, scheduled 1 year ago

We're performing an operating system upgrade without outage at zone southamerica-east1-a

Network GCP_Router_Prd_Up

Identified - Sum of GCP Cloud Router instances at zone southamerica-east1-a is mismatched

Sep 21, 12:18 -03

Resolved

Sep 21, 12:23 -03

HarborMajorOutage

Identified - We're investigating a reported failure on Harbor

Sep 21, 06:15 -03

Resolved

Sep 21, 06:20 -03

HarborMajorOutage

Identified - We're investigating a reported failure on Harbor

Sep 21, 04:22 -03

Resolved

Sep 21, 04:27 -03

Network GCP_Interconnect_Up

Identified - GCP Interconnect is down at region southamerica-east1 at zone southamerica-east1-a

Sep 21, 02:37 -03

Resolved

Sep 21, 14:02 -03

DNS DNSCorpPartialOutage

Identified - We're investigating a reported failure in DNS name resolution impacting users at zone: sa-east-1a

Sep 21, 01:44 -03

Resolved

Sep 21, 02:04 -03

Network GCP_Interconnect_Low_Traffic

Identified - GCP Interconnect attachment has low traffic at region southamerica-east1 at zone southamerica-east1-a

Sep 21, 01:39 -03

Resolved

Sep 21, 14:04 -03

Network GCP_BgppeerRcd_prd

Identified - Prefixes not received by itc/vpn at zone southamerica-east1-a

Sep 21, 01:37 -03

Resolved

Sep 21, 14:02 -03

Network GCP_BgppeerSnd_Prd_itx

Identified - Prefixes not sent to peer by itx at zone southamerica-east1-a

Sep 21, 01:37 -03

Resolved

Sep 21, 14:02 -03

Network GCP_VPN_TrafficLink

Identified - The Data Center traffic was switched from ITC link to VPN at southamerica-east1

Sep 21, 01:37 -03

Resolved

Sep 21, 14:02 -03

Network GCP_Interconnect_Low_Traffic

Identified - GCP Interconnect attachment has low traffic at region southamerica-east1 at zone southamerica-east1-a

Sep 21, 00:20 -03

Resolved

Sep 21, 01:30 -03

Network NetworkLatency

Identified - We're investigating performance issues on network at zone: sa-east-1a

Sep 21, 00:14 -03

Resolved

Sep 21, 13:59 -03

Network GCP_BgppeerRcd_prd

Identified - Prefixes not received by itc/vpn at zone southamerica-east1-a

Sep 21, 00:13 -03

Resolved

Sep 21, 01:28 -03

Network GCP_BgppeerSnd_Prd_itx

Identified - Prefixes not sent to peer by itx at zone southamerica-east1-a

Sep 21, 00:13 -03

Resolved

Sep 21, 01:28 -03

Network GCP_Interconnect_Up

Identified - GCP Interconnect is down at region southamerica-east1 at zone southamerica-east1-a

Sep 21, 00:13 -03

Resolved

Sep 21, 01:28 -03

Network GCP_VPN_TrafficLink

Identified - The Data Center traffic was switched from ITC link to VPN at southamerica-east1

Sep 21, 00:11 -03

Resolved

Sep 21, 01:26 -03

Network VpnTrafficLink

Identified - The Data Center traffic was switched from DX link to VPN at sa-east-1a

Sep 21, 00:10 -03

Resolved

Sep 21, 14:00 -03

Wednesday 20th September 2023

Network GCP_Router_Dev_Up

Identified - Sum of GCP Cloud Router instances at zone southamerica-east1-a is mismatched

Sep 20, 23:40 -03

Resolved

Sep 20, 23:45 -03

DNS InternalDNSisUnhealthy

Identified - Internal Cluster DNS is falling for kubernetes local services queries

Sep 20, 21:08 -03

Resolved

Sep 20, 21:13 -03

DNS InternalDNSisUnhealthy

Identified - Internal Cluster DNS is falling for kubernetes local services queries

Sep 20, 20:57 -03

Resolved

Sep 20, 21:02 -03

Tuesday 19th September 2023

No incidents reported

Monday 18th September 2023

No incidents reported

Sunday 17th September 2023

No incidents reported

Saturday 16th September 2023

Network GCP_BgppeerRcd_dev

Identified - Prefixes not received by itc/vpn at zone southamerica-east1-a

Sep 16, 06:33 -03

Resolved

Sep 16, 06:38 -03

Friday 15th September 2023

No incidents reported