From the course: Designing Highly Scalable and Highly Available SQL Databases

Unlock the full course today

Join today to access over 22,500 courses taught by industry experts or purchase this course individually.

Partitioning for scalability

Partitioning for scalability

From the course: Designing Highly Scalable and Highly Available SQL Databases

Start my 1-month free trial

Partitioning for scalability

- [Instruction] One of the costliest operations in a database, it's basically scanning for data. So the more we can reduce the amount of data we need to scan, the better our performance will be. Now, partitioning is a great technique for that, and it's a really robust technique because there are different ways to implement it and it really works well. And basically the idea is, when you have a really large table, it's really difficult to query efficiently, your indexes get larger, you have to scan more. And so what we wanted to is be able to basically subdivide these large tables, and we can do that either by separating them or splitting them based on rows or based on columns. But each of those splits, each of the subsets of the data, we refer to as a partition. And a partition can be either a horizontal partition or a vertical partition. Now, with horizontal partitioning, we limit scans to a subset of the partitions.…

Contents