Working with infrastructure/operating systems
Infrastructure design plays an important role in HBase optimization and performance. An HBase engineer is pivotal for making the right choices during the initial phase of the design as once the data grows exponentially, it starts bringing in operational challenges. In addition to this, the infrastructure should perform to the predefined performance criteria as the cluster transitions from small to medium and from medium to large.
Getting ready…
HBase works in the master-slave pattern, wherein a master comprises HDFS NameNode, MapReduce JobTracker, and HBase Master, and the slave contains HDFS DataNode, the MapReduce TaskTrackers, and the HBase region servers. It's better to collocate DataNode HBase region server, which helps in data locality and hence increases the performance of the system as the data does not cross the network.
HBase also requires managing a separate component of ZooKeeper; this manages the HBase cluster.
It's always better to...
