Past Incidents

Friday 19th January 2024

DNS DNSCorpPartialOutage

Identified - We're investigating a reported failure in DNS name resolution impacting users at zone: sa-east-1a

Jan 19, 14:45 -02

Resolved

Jan 19, 15:55 -02

Thursday 18th January 2024

Kubernetes Infrastructure Upgrade without outage at Kubernetes AWS sa-east-1a, scheduled 1 year ago

We're performing an operating system upgrade without outage at Kubernetes AWS sa-east-1a

HarborMajorOutage

Identified - We're investigating a reported failure on Harbor

Jan 18, 22:51 -02

Resolved

Jan 18, 22:52 -02

Authentication LoginFailure

Identified - We're investigating a failure to authenticate on Kubernetes at zone: sa-east-1a

Jan 18, 19:07 -02

Resolved

Jan 18, 19:12 -02

Wednesday 17th January 2024

Authentication LoginFailure

Identified - We're investigating a failure to authenticate on Kubernetes at zone: us-central1-a

Jan 17, 21:00 -02

Resolved

Jan 17, 21:05 -02

Network ConnectionMajorOutage

Identified - We're investigating a failure to communicate with all datacenter vlans at zone: us-central1-a

Jan 17, 10:28 -02

Resolved

Jan 17, 10:33 -02

Network GCP_VPN_Dev_Up

Identified - GCP VPN is down at region us-central1 at zone southamerica-east1-a

Jan 17, 06:03 -02

Resolved

Jan 17, 06:08 -02

Network ConnectionMajorOutage

Identified - We're investigating a failure to communicate with all datacenter vlans at zone: us-central1-a

Jan 17, 06:01 -02

Resolved

Jan 17, 06:06 -02

Tuesday 16th January 2024

Network GCP_VPN_Dev_Up

Identified - GCP VPN is down at region us-central1 at zone southamerica-east1-a

Jan 16, 22:35 -02

Resolved

Jan 16, 22:40 -02

Network ConnectionMajorOutage

Identified - We're investigating a failure to communicate with all datacenter vlans at zone: us-central1-a

Jan 16, 22:32 -02

Resolved

Jan 16, 22:37 -02

Network GCP_BgppeerRcd_prd

Identified - Prefixes not received by itc/vpn at zone southamerica-east1-a

Jan 16, 22:17 -02

Resolved

Jan 16, 22:22 -02

Network NetworkLatency

Identified - We're investigating performance issues on network at zone: sa-east-1a

Jan 16, 22:16 -02

Resolved

Jan 16, 22:21 -02

Monday 15th January 2024

Network NetworkLatency

Identified - We're investigating performance issues on network at zone: sa-east-1a

Jan 15, 03:17 -02

Resolved

Jan 15, 05:37 -02

Network GCP_VPN_TrafficLink

Identified - The Data Center traffic was switched from ITC link to VPN at southamerica-east1

Jan 15, 03:16 -02

Resolved

Jan 15, 05:41 -02

Network VpnTrafficLink

Identified - The Data Center traffic was switched from DX link to VPN at sa-east-1a

Jan 15, 03:12 -02

Resolved

Jan 15, 05:37 -02

Sunday 14th January 2024

No incidents reported

Saturday 13th January 2024

Network GCP_Router_Dev_Up

Identified - Sum of GCP Cloud Router instances at zone southamerica-east1-a is mismatched

Jan 13, 17:53 -02

Resolved

Jan 13, 17:58 -02

Network GCP_VPN_Dev_Up

Identified - GCP VPN is down at region us-central1 at zone southamerica-east1-a

Jan 13, 09:37 -02

Resolved

Jan 13, 09:42 -02

Network ConnectionMajorOutage

Identified - We're investigating a failure to communicate with all datacenter vlans at zone: us-central1-a

Jan 13, 09:34 -02

Resolved

Jan 13, 09:39 -02

Friday 12th January 2024

Network GCP_VPN_Dev_Up

Identified - GCP VPN is down at region us-central1 at zone southamerica-east1-a

Jan 12, 22:51 -02

Resolved

Jan 12, 22:56 -02

Network ConnectionMajorOutage

Identified - We're investigating a failure to communicate with all datacenter vlans at zone: us-central1-a

Jan 12, 22:48 -02

Resolved

Jan 12, 22:53 -02