Working with Big Data and cloud sources

While flat files and databases are the most common types of sources that you use from PDI, there are many other types of data sources available. People have started to leverage the capabilities of tools such as Hadoop, NoSQL databases, and cloud services. In this section, you will learn to connect, read data from, and load data into some of these big data sources with PDI.

Reading files from an AWS S3 instance

S3 is a scalable storage space and is a common location for files to be processed. If you have files in S3 and want to read them, you don't have to download them. PDI allows you to read those files directly from the Amazon Web Services (AWS) Simple Storage Service...