A New Standard For Database Benchmarking | Performance Under Adversity

Description

For the last 10 years we have built CockroachDB with the core belief that performance isn’t about speed – it’s about survival. In fact, we believe resilience is the new performance metric. That’s why we’ve released a novel methodology for benchmarking modern databases that tests the impact of real-world conditions faced by application and infrastructure teams every day. The shift from measuring peak performance allows us to measure how infrastructure performs under pressure. Then, we show how CockroachDB responds to these conditions, preventing downtime, delivering business value and fast, consistent performance, and allowing teams to meet their overall TCO goals. Our escalating phases of adversity: 1) Baseline Performance: Measure steady-state throughput under normal conditions. 2) Internal Operational Stress: Simulate resource-intensive operations such as change data capture, full backups, schema changes, and rolling upgrades. 3) Disk Stalls: Randomly inject I/O freezes to evaluate storage resilience. 4) Networking Failures: Simulate partial and full network failures preventing one partition from communicating with nodes in another partition. 5) Node Restarts: Unpredictably reboot database nodes (1 at a time) to test recovery time and impact to performance. 6) Zone Outages: Take down an entire Availability Zone. 7) Regional Outages: Take down an entire Region. A New Standard For Database Benchmarking | Performance Under Adversity 00:00 Nothing has ever stayed perfect in production 00:39 What is Performance under Adversity? 01:14 Inside the Performance under Adversity Dashboard 02:00 Our database benchmarking methodology 03:08 Why CockroachDB is the most resilient database 03:40 A deeper dive into CPU usage, memory usage, and disk operations 04:09 Traditional databases aren't doing enough to keep your workloads online About Cockroach Labs: Cockroach Labs is a pioneering software company at the forefront of database technology, dedicated to delivering resilient and scalable database solutions to run mission-critical workloads for the world's most important businesses. With a mission to scale when others fail, Cockroach Labs is revolutionizing the way businesses manage their data with its innovative cloud native distributed SQL database, CockroachDB. #benchmarking #databaseperformance