Processing big data
To perform data analysis, the first and foremost thing needed is to process the data and transform it for the required analytical needs. In other words, the goal here is to do the analysis, and to achieve this, data processing and data transformation are the means. So, the focus here will be on the data processing and data transformations. The tools and technologies discussed here will revolve around data processing and data transformations. Even though analysis is the end goal, focusing on the data processing and data transformation aspects, the end goal will be achieved.
Over the last decade, many technologies have arrived in the market that process large scale data. These have many things in common. They are open source, they run on commodity hardware, they support clustering inherently, and they are backed by reputed companies to make the technology production-ready at scale.
Apache Bigtop is an Apache Foundation project that helps the infrastructure engineers with...
