Oozie
Oozie (see http://oozie.apache.org/) is an open source workflow coordination and schedule service to manage data processing jobs. Oozie workflow jobs are defined in a series of nodes in a Directed Acyclical Graph (DAG). Acyclical here means that there are no loops in the graph and all nodes in the graph flow in one direction without going back. Oozie workflows contain either the control flow node or action node:
- Control flow node: This either defines the start, end, and failed node in a workflow or controls the workflow execution path such as decision, fork, and join nodes.
- Action node: This defines the core data processing action job such as MapReduce, Hadoop filesystem, Hive, Pig, Java, Shell, e-mail, and Oozie subworkflows. Additional types of actions are also supported by developing extensions.
Oozie is a scalable, reliable, and extensible system. It can be parameterized for workflow submission and scheduled to run automatically. Therefore, Oozie is very suitable for lightweight...
