Using the Parquet format to speed up a Power BI report
Now that you have learned how to take advantage of the Parquet format in both Python and R, you can apply this knowledge to real-world cases in Power BI. An example might be as follows.Suppose you need to integrate a report commissioned by your boss with data on the maximum flight delays in the U.S. on each day of the past two months for each departure airport. At the beginning of each month, a CSV can be retrieved with information on the above flights for the previous month. To be consistent with the data we have available, assume that this integration was commissioned for you in December 2012 and that you were able to find all data for flights from October 1987 through November 2012.In order to implement a data flow that optimizes both the time it takes to load new flight data and the time it takes to perform analysis on all the data in the history, the workflow to be followed will be as follows:
- At first, the Parquet dataset of...