Monitoring and controlling costs
As organizations deal with increasingly large volumes of data, optimizing cost becomes a fundamental aspect of data processing. In this section, we will explore best practices for monitoring and controlling costs in BigQuery to help you make the most of your data exploration and preparation efforts without overspending.
Query plan and query performance insights
After a query is complete, you can review the query plan in the cloud console. The query plan provides details about query stages and steps to complete that can help you identify ways to improve performance. After running a query, click EXECUTION DETAILS to view the query plan, as shown in Figure 10.5:
Figure 10.5 – Query plan details in the cloud console
In the query plan, you can view the longest execution time steps to troubleshoot any bottlenecks. In the preceding example, the longest time was spent reading the input. The query was counting columns...
