How to survive 100x scaling events: Picking the right technologies early | RoachFest 2023

Description

In mid 2023, the tech world as we know exploded. LLMs took the first steps towards providing AGI capabilities for everyday use and every company in the world was looking at how it might change their business model. Noteable released a plugin with the first wave of ChatGPT's offering and generated instant interest in their free multi-tenant application to the tune of roughly 100x traffic in a little over a month. Due to the technology choices that had been made early to prepare for larger customers, including CockroachDB, they were able to respond to the growth with minimal changes and without rearchitecting their application. In this talk from RoachFest 2023, Noteable CTO and Co-Founder Matthew Seal shares how team achieved staying online and minimal disruption and what technology decisions were helpful to avoid architectural threats to their business plans. How to survive 100x scaling events: Picking the right technologies early | RoachFest 2023 00:00 Welcome/Introduction 01:19 What does Noteable do? 02:13 The impact of LLMs and Chat plugins launching on Noteable 04:36 How Noteable futureproofed their tech stack 05:27 How to design a scaling response playbook 08:04 How to choose technology that can scale 10:45 How does CockroachDB prevent failure? 13:03 Why did Noteable choose Datadog? 13:45 Why did Noteable choose Kubernetes? 14:52 Why did Noteable choose FastAPI? 15:39 Scaling learnings #AI #LLM #CockroachDB #Distributedsql