Loading MySQL data to QuickSight using the AWS pipeline

In this section, we will look into the data flow path from https://www.ed.gov/ to QuickSight that uses a MySQL database. The source data is obtained from the public site and provides information about colleges in the USA.

The path to get to QuickSight involves the following steps:

1. Uploading data to S3.

2. Creating an AWS Data Pipeline to load data from S3 to MySQL.

3. Loading data from MySQL to QuickSight.

Pre-requisites

The following are the pre-requisites to load data from MySQL to QuickSight:

• Must have an RDS instance created. In this example, I will show an RDS MySQL instance.

• Data file must be CSV. It should not contain any header rows.

• You must have a database username and password that can connect to the database from QuickSight with the SELECT permission on some system tables so that QuickSight can estimate the table size. The following table identifies the system tables that the user account needs permission to select:

  Database type

  Access...