Chapter 7. Running Scalding in Production

We now know how to implement complex pipelines, use appropriate design patterns, and test our Scalding data processing applications in multiple layers. In this chapter, we will look at how to productionize a job, and more specifically, we will see how to:

• Deploy, execute, and schedule
• Coordinate task execution
• Configure using property files and Hadoop parameters
• Monitor and optimize