What do you get with Print?

Instant access to your digital eBook copy whilst your Print order is Shipped

Paperback book shipped to your preferred address

Download this book in EPUB and PDF formats

Access this title in our online reader with advanced features

DRM FREE - Read whenever, wherever and however you want

Getting Started with PDI

Pentaho Data Integration (PDI) is a popular business intelligence tool, used for exploring, transforming, validating, and migrating data, along with other useful operations. PDI allows you to perform all of the preceding tasks thanks to its friendly user interface, modern architecture, and rich functionality. This book will introduce you to the tool, giving you a quick understanding of the daily tasks that you can perform with it.

We will cover the following topics in this chapter:

Introducing PDI
Installing PDI
Configuring the graphical designer tool
Creating a simple transformation
Understanding the Kettle home directory

Creating a simple transformation

Transformations and jobs are the main PDI artifacts. Transformations are data-flow oriented entities, while jobs are task-oriented. In this book, we will start by learning all about transformations, focusing on jobs later. To get a quick idea of what, exactly, a transformation is, we will start by creating a simple one. This will also allow you to see what it's like to work with Spoon.

Our first transformation will find out the current version of PDI (Kettle), and will print the value to the log. Proceed as follows:

On the Welcome page, click on the New transformation link, located under the WORK link group. Alternatively, press Ctrl + N.
A new tab will appear, with the title Transformation 1. It's in this tab that you will create your work.
To the left of the screen, under the Design tab, you'll see a tree of folders. Expand the Input folder by double-clicking on it.

Note that if you work in macOS, a single click is enough.

Then, left-click on the Get System Info icon, and, without releasing the button, drag and drop the selected icon to the work area (that is, the blank area that occupies almost all of the screen). You should see something like this:

Dragging and dropping a step

Double-click on the Get System Info icon. A configuration window will show up. Fill in the first row in the grid, as shown in the following screenshot. Note that you don't have to type the Kettle version. Instead, you can choose it from a list of available options:

Configuring the Get System Info step

In the Design tab, double-click on the Utility folder, click on the Write to log icon, and drag and drop it to the work area.
Put the mouse cursor over the Get System Info icon and wait until a tiny toolbar shows up, as shown in the following screenshot:

Mouseover assistance toolbar

Click on the output connector (the icon highlighted in the preceding image) and drag it towards the Write to log icon. A greyed hop is displayed.
When the mouse cursor is over the Write to log step, release the button. A link (a hop, from now on) is created, from the first step to the second one. The screen should look as follows:

Connecting steps with a hop

Let's add some color note to our work, as follows:

Right-click anywhere in the work area to bring up a contextual menu.
In the menu, select the New Note... option. A note editor will appear.
Type a description, such as My first transformation. Select the Font style tab and choose a nice font and some colors for your note, and then click on OK. The following should be the final result:

My first transformation

Save the transformation by pressing Ctrl + S. PDI will ask for a destination folder. Select the folder of your choice, and give the transformation a name. PDI will save the transformation as a file with a ktr extension (for example, sample_transformation.ktr).

Finally, let's run the transformation to see what happens:

Click on the Run icon, located in the transformation toolbar:

Run icon in the transformation toolbar

A window named Run Options will appear. Click on Run.
At the bottom of the screen, you should see a log with the results of the execution:

Execution Results

Understanding the Kettle home directory

When you run Spoon for the first time, a folder named .kettle is created in your home directory by default. This folder is referred to as the Kettle home directory.

The folder contains several configuration files, mainly created and updated by the different PDI tools. Among these files, there is the kettle.properties file.

The purpose of the kettle.properties file – created along with the .kettle folder, the first time you run Spoon – is to contain variable definitions with a broad scope: Java Virtual Machine. Therefore, it's the perfect place to define general settings; some examples are as follows:

Database connection settings: host, database name, and so on
SMTP settings: SMTP server, port, and so on
Common input and output folders
Directory to send log files to

Before continuing, let's add some variables to the file. Suppose that you have two folders, named C:/PDI/INPUT and C:/PDI/OUTPUT, which you will use for storing files. The objective will be to add two variables, named INPUT_FOLDER and OUTPUT_FOLDER, containing those values:

Locate the Kettle home directory. If you work in Windows, the folder could be C:\Documents and Settings\<your_name> or C:\Users\<your_name>, depending on which Windows version you have. If you work in Linux (or similar) or macOS, the folder will most likely be /home/<your_name>/.
Edit the kettle.properties file. You will see that it only contains commented sample lines.
You can safely remove the contents of the file and define your own variables by typing the following lines:

       INPUT_FOLDER=C:/PDI/INPUT
       OUTPUT_FOLDER=C:/PDI/OUTPUT

Save the file and restart Spoon, so that it can recognize the variables defined in the file. We will learn how to use these variables in Chapter 2, Getting Familiar with Spoon.

Key benefits

Take away the pain of starting with a complex and powerful system

Simplify your data transformation and integration work

Explore, transform, and validate your data with Pentaho Data Integration

Description

Pentaho Data Integration(PDI) is an intuitive and graphical environment packed with drag and drop design and powerful Extract-Transform-Load (ETL) capabilities. Given its power and flexibility, initial attempts to use the Pentaho Data Integration tool can be difficult or confusing. This book is the ideal solution. This book reduces your learning curve with PDI. It provides the guidance needed to make you productive, covering the main features of Pentaho Data Integration. It demonstrates the interactive features of the graphical designer, and takes you through the main ETL capabilities that the tool offers. By the end of the book, you will be able to use PDI for extracting, transforming, and loading the types of data you encounter on a daily basis.

What you will learn

Design, preview and run transformations in Spoon

Run transformations using the Pan utility

Understand how to obtain data from different types of files

Connect to a database and explore it using the database explorer

Understand how to transform data in a variety of ways

Understand how to insert data into database tables

Design and run jobs for sequencing tasks and sending emails

Combine the execution of jobs and transformations

What do you get with Print?

Instant access to your digital eBook copy whilst your Print order is Shipped

Paperback book shipped to your preferred address

Download this book in EPUB and PDF formats

Access this title in our online reader with advanced features

DRM FREE - Read whenever, wherever and however you want

Frequently bought together

$54.99

$54.99

Pentaho Data Integration Quick Start Guide

$32.99

Total $ 142.97

MetalPesto Jan 19, 2020

Das Buch bietet einen Praxis-orientierten Einstieg in die Nutzung von PDI. Nicht mehr und nicht weniger. Kann man alles in der offiziellen Dokumentation und über andere Quellen herausfinden, aber wenn man keine Praxiserfahrung mit PDI hat und sich etwas Zeit sparen möchte, ist man mit diesem Buch gut beraten. Eine umfassende Vorstellung aller Steps sucht man allerdings vergebens.

Amazon Verified review

Pentaho Data Integration Quick Start Guide: Create ETL processes using Pentaho

What do you get with Print?

Pentaho Data Integration Quick Start Guide

Getting Started with PDI

Introducing PDI

Installing PDI

Configuring the graphical designer tool

Creating a simple transformation

Understanding the Kettle home directory

Summary

Page 1 of 7

Key benefits

Description

Who is this book for?

What you will learn

Product Details

What do you get with Print?

Product Details

Frequently bought together

Table of Contents

Recommendations for you

Customer reviews

People who bought this also bought

About the author

FAQs

Pentaho Data Integration Quick Start Guide: Create ETL processes using Pentaho

What do you get with Print?

Key benefits

Description

Who is this book for?

What you will learn

Product Details

What do you get with Print?

Product Details

Packt Subscriptions

Frequently bought together

Table of Contents

Recommendations for you

Customer reviews

People who bought this also bought

About the author

FAQs