CockroachDB on Kubernetes: Trials and triumphs | RoachFest 2023

Description

This presentation by the internal infrastructure storage team at City Storage Systems focused on managing storage as a service provides a practical, in-depth look at their three-year experience of running CockroachDB on Kubernetes as their main production database. We'll share the lessons learned from building a home-grown K8s operator and achieving multi-region and multi-cloud compatibility, including a successful cloud migration. The team discusses cost and reliability tradeoffs, as well as showcase trials and triumphs in implementing resizable disks, CPU autoscaling, topology considerations, disaster recovery tooling, and more. Join us as we explore the highs and lows of their cloud adventure. 00:00 What is City Storage Systems and how do they use CockroachDB? 01:08 Why are they running CockroachDB? 02:19 The benefits of Kubernetes 03:12 Provisioning a CockroachDB cluster on Kubernetes 04:16 Day 2 Operations - Scaling disks 06:35 Day 2 Operations - Scale in horizontally 07:53 Day 2 Operations - Scale out horizontally 09:18 Lessons from the journey so far 10:44 Kubernetes operator pattern 11:39 Writing a CockroachDB operator 13:13 Scaling all the things - Adding and removing nodes 15:22 Scaling all the things - Disks Take 2 16:09 Lessons learned from scaling 17:19 Multi-region deployments and disaster recovery 19:28 Cloud migration with CockroachDB and the Kubernetes Operator 21:47 Lessons learned from building with a cloud-native mindset 23:40 Vertical auto scaling - CPU recommendations 25:48 Scaling Disks - Take 3 - Scale up 28:34 CockroachDB on Spotnodes 30:59 Key takeaways CockroachDB on Kubernetes: Trials and triumphs and other keynotes from RoachFest 2023 at our on-demand page: #CockroachDB #Kubernetes #K8s #distributedsql