Summary
In this chapter, we covered data cleansing and transformation, two critical data preparation steps for data analysis and reporting. We discussed the importance of data quality and introduced several data cleansing and transformation techniques. Then, we demonstrated how to use SQL to cleanse and transform data in BigQuery and introduced Cloud Dataprep as an alternative approach for visual data preparation.
The following are the key takeaways from this chapter:
- Data cleansing and transformation are important steps in the data preparation process
- Data quality issues can negatively impact data analysis and reporting, so it is important to determine the integrity of your data
- SQL is powerful for data cleansing and transformation in BigQuery
- Cloud Dataprep is a visual data preparation tool that simplifies the process of cleaning and transforming data
In the next chapter, we will discuss data preparation best practices and cost control for BigQuery....