Design your first Hadoop dashboard

Download any sample big data files or extract logs from systems using Flume and so on. For the purpose of the book we will be downloading the dataset from the following URL:

http://www.seanlahman.com/?s=lahman591-csv.zip

Extract the ZIP file.

Upload the data file to HDFS by following these steps:

1. Navigate to the HDFS files directory from the Hortonworks web interface.
   

2. Navigate to /usr/maria_dev and click on the Upload button.
3. Click on the Browse button, navigate to the location where we extracted the downloaded ZIP file, and select the batting.csv file.
4. Now, open a Hive view by clicking on the Hive View button.
5. In this view, create a table to hold the data by executing the following command:

         create table intermediate_batting (col_value STRING);
   
   

6. Upon execution of the query, we can view the intermediate_batting table under default databases.
7. Execute the following command to load the batting.csv data file into the intermediate_batting table:

     ...