Optimizing Pipelines for Performance
This chapter will teach you how to measure aggregation performance and identify bottlenecks. Then, you will learn essential techniques to apply to suboptimal pipeline parts to reduce the aggregation's total response time. Adopting these principles may mean the difference between aggregations completing in a few seconds versus minutes, hours, or even longer for sizeable datasets.
The chapter will cover the following:
- What an explain plan is and how to use it
- How blocking stages can significantly impede performance
- How to refactor your pipelines to remove bottlenecks