Ops 'N' Hops · 2024-03-29 · 1h 19m
In the inaugural episode of the Opsie Daisy podcast, Derek and Malcolm discuss the June 2019 outage at GCP, which was a major networking outage that affected all US regions. The outage lasted between three hours and 20 minutes to four hours and 25 minutes, depending on the region. The impact was significant, with packet loss and service disruptions across multiple regions. The outage also affected some G Suite services, highlighting the interconnectedness of Google's services. The root cause of the outage was a combination of a software bug and misconfiguration in the maintenance event, leading to the failure of the network control plane jobs. During the conversation, the principal themes discussed were the challenges and limitations of the Border Gateway Protocol (BGP), the impact of the Google outage, and the root cause analysis and follow-up actions taken by Google. The conversation highlighted the lack of security in BGP and the difficulty of upgrading the protocol due to the diversity and scale of the internet. The Google outage was caused by a combination of misconfigurations and a software bug, resulting in network congestion and loss of traffic.
Journey to Tech, Iac, Terraform, Cybersecurity, and More with Ned Bellavance70 / 100Leadership, Working in the Public Sector, and the AWS IQ Program with Josh GrantPlatform Engineering, Moving between startups and enterprise, and Security with Reuben deVries Learning for everyone, Women in Tech, and Moving between tech roles with Christina RobertsWomen in Tech, Multi Cloud, And becoming a Manager with Jenn Bergstrom