In this section, we will learn how to create the environment to start writing applications for MapReduce programming. The programming is typically done in Java. The development of a MapReduce application follows standard Java development principles as follows:
- Usually, developers write the programs in a development environment such as Eclipse or NetBeans.
- Developers do unit testing usually with a small subset of data. In case of failure, they can run an IDE Debugger to do fault identification.
- It is then packaged in JAR files and is tested in a standalone fashion for functionality.
- Developers should ideally write unit test cases to test each functionality.
- Once it is tested in standalone mode, developers should test it in a cluster or pseudo-distributed environment with full datasets. This will expose more problems, and they can be fixed. Here debugging...
