How GitLab Rebuilt Its CI Pipeline for 5 Million Jobs Daily - The CTO Podcast with Fexingo

Topics in this episode

Continuous Integration gitlab ci ci pipeline architecture 5 million jobs daily gitlab job scheduler

Episode notes

In this episode of The CTO Podcast, Lucas and Luna dive into the engineering challenges behind GitLab's continuous integration platform. With over 5 million CI jobs running daily in early 2026, GitLab had to redesign its job scheduling, artifact storage, and runner orchestration from scratch. We explore the specific architectural decisions: moving from a monolithic Rails scheduler to a sharded Go-based dispatcher, adopting object storage with a custom caching layer for artifacts, and implementing a priority queue that reduced average job wait time by 40 percent. We also discuss the trade-offs between reliability and cost, including how GitLab handles peak demand during product launches. This episode is packed with concrete numbers and lessons for any engineering leader building developer tooling at scale. #GitLab #ContinuousIntegration #CI #EngineeringLeadership #SystemArchitecture #DevOps #GoLanguage #Rails #JobScheduling #ObjectStorage #Caching #Scalability #DeveloperTools #PlatformEngineering #CTO #BusinessAndTechnology #FexingoBusiness #BusinessPodcast Keep every episode free: buymeacoffee.com/fexingo

Related episodes across the Index

Other episodes covering the same guests and topics, from across The B2B Podcast Index.

More from The CTO Podcast with Fexingo

All episodes →

Explore the best B2B Engineering & DevTools podcasts →