Implementing a Map Reduce action job using Oozie
In the previous recipe, we talked about how to use a Sqoop action to import data to HDFS. In this recipe, we are going to take a look at how to execute Map Reduce jobs using Oozie.
Getting ready
To perform this recipe, you should have a running Hadoop cluster as well as the latest version of Oozie installed on it.
How to do it...
Any Oozie job execution consists of two important things, workflow.xml
and a properties file. The Workflow.xml
file is where we need to specify the flow of execution. The following is an example of workflow.xml
, which uses the MR action. Here, we also need to provide the jar file that contains the the map reduce code:
<workflow-app xmlns="uri:oozie:workflow:0.2" name="map-reduce-wf"> <start to="mr-node"/> <action name="mr-node"> <map-reduce> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode}</name-node> <prepare> <delete path="${nameNode}/user/${wf:user...