Reading several files at the same time

Sometimes you have several files to read, all with the same structure, but different data. In this recipe, you will see how to read those files in a single step. The example uses a list of files containing names of museums in Italy.

Getting ready

You must have a group of text files in a directory, all with the same format. In this recipe, the names of these files start with museums_italy_ for example, museums_italy_1, museums_italy_2, museums_italy_roma, museums_italy_genova, and so on.

Each file has a list of names of museums, one museum on each line.

How to do it...

Carry out the following steps:

1. Create a new transformation.

2. Drop a Text file input step onto the work area.

3. Under the File or directory tab, type the directory where the files are.

4. In the Regular Expression textbox, type: museums_italy_.*\.txt

5. Then click on the Add button. The grid will be populated, as shown in the following screenshot:

   

   Note

   ${Internal.Transformation.Filename.Directory} is a variable...