Copying data to an on-premises cluster
In this recipe, we'll add a package that will copy local data to the local cluster.
Getting ready
This recipe assumes that you have access to an on-premises cluster and have created a folder to hold the files in it from the previous recipe.
How to do it...
- In the solution explorer, open (expand) the
ETL.DW
project and right-click on it to add a new package. Name itFactOrdersToHDPCuster.dtsx
.
- Go to the
Parameters
tab and add a new parameter:Name
:LoadExecutionId
Data type
:Int64
Value
: Leave the default value0
Sensitive
: Leave the default valueFalse
Required
:True
- Add a data flow task on the control flow and name it
dft_FactOrders
. - In the data flow task, drag and drop an OLE DB source. Name it
ole_src_DW_vwFactOrders
. - Double-click on it to open the OLE DB source editor.
- Set the OLE DB connection manager to
cmgr_DW
. - For data access mode, use the SQL command.
- Set the SQL command text to the following:
SELECT OrderDate, FirstName, LastName, CompanyName, Category...