Scaling for 2 billion events per day with Principal Software Engineer at Red Ventures

Description

With a growing library of media properties including CNET, Lonely Planet, and Bankrate, Red Ventures’ data platform has scaled from handling 16 million events per day to nearly 2 billion. To dive into the evolution of their architecture, software scaling, and understand how data effortlessly travels through their systems, our host David Joy sat down with Principal Software Engineer Majid Fatemian. Join as we discuss: ✔️ Why Red Ventures migrated from SQL Server to Amazon Redshift ✔️ How the data landscape has changed over the last two decades ✔️ The challenges every leader should expect when running a data platform ✔️ Majid’s time at Ubisoft and his involvement in one of David’s favorite games, Far Cry 2 Scaling for 2 billion events per day with Principal Software Engineer at Red Ventures 00:00 Welcome/Introduction 00:48 What is Red Ventures and what is Majid’s role? 03:00 What did the data landscape look like when Majid joined Red Ventures? 09:56 What does Red Ventures’ data platform look like? And what are the business implications? 13:53 Why Red Ventures moved from SQL Server to the cloud 18:13 The biggest challenges when running a data platform 22:20 What does the upstream look like in Red Ventures’ data platform? 24:50 What does a Principal Software Engineer do at Red Ventures? 27:37 Majid on his time at Ubisoft 31:17 Data challenges in the gaming industry 34:26 How does Majid see the future of data? Big Ideas In App Architechture is a #techpodcast for architects and engineers who are building modern, data-intensive applications and systems. In each weekly episode, an innovator joins host David Joy to share useful insights from their experiences building reliable, scalable, maintainable systems. #softwareengineering #dataplatform #cloudmigration Follow Cockroach Labs ✔️ Website: https://cockroachlabs.com/ ✔️ Twitter (X): https://twitter.com/cockroachdb ✔️ Linkedin: https://www.linkedin.com/company/cockroach-labs/ ✔️ Facebook: https://www.facebook.com/cockroachlabs ✔️ Instagram: https://www.instagram.com/cockroachdb ✔️ Threads: https://www.threads.net/@cockroachdb