Time for action – generating top average scores by copying and getting rows
In this section, we will split our work into two different transformations:
- The first for reading the examination data and preparing it for further processing
- The second for picking that prepared data and do some work with it
As said, you will need the same input files you've been working with. Once you have the files, you are ready for work:
- Open Spoon and create a new transformation.
- Just as you did in the previous section, define a named parameter with the name of the file to read, and read the examination file with a Text file input step.
Note
It's not mandatory to use the named parameter, but we do it for two reasons: first, for getting the habit of creating reusable transformations and second, because we will use that parameter in the last sections of this chapter.
- Use a Java Filter step to filter the students with low scores. As a filter enter the following:
(english<75)&&(mathematics...