Performance tips
Optimizing performance is a complicated topic, even after learning about all the different perspectives in this chapter. As with all optimization topics, you’ll have to test different approaches for your situation. However, we have several general performance tips:
- Connect your query to a fast data source. If your source system is slow, consider moving the data to a faster source or storing your data in a dataflow.
- Maximize the number of steps that your query folding mechanisms can fold. If you’re adept at SQL, consider crafting an efficient SQL query and apply the
EnableFoldingparameter. If SQL is not your strength, prioritize placing foldable steps early in your query. This approach helps ensure that your data source handles most of the transformations. - When your query steps no longer fold, the next focus should be reducing your query’s memory usage. That means filtering rows and removing columns as soon as possible....
