Scaling our SaaS offering to thousands of clusters // Dax McDonald (DoK Day North America 2022)

Data on Kubernetes Community

From the DoK Day North America 2022 (https://youtu.be/YWTa-DiVljY)
ABSTRACT
Sourcegraph is a code intelligence platform that helps our customers to understand their code better. As we have scaled up, we are starting to run hundreds of instances for our customers in separate kubernetes clusters.
Running dozens of distinct clusters with a stateful application that scales horizontally and vertically has been challenging. Sourcegraph's inherently stateful nature requires thoughtful planning to achieve resilience while making tradeoffs to keep costs down. This talk will discuss our methodologies to allow our cluster to scale while minimizing drift across multiple customer deployments. I will also cover our use of Terraform, ArgoCD, and Helm to manage the application and infrastructure. Finally, this talk will discuss our disaster recovery strategies that allowed our organization to achieve SOCII compliance while iterating quickly.
If you are looking to scale out a managed offering at your organization, learn from our mistakes and come to this talk!