Monitoring the Storm cluster using JMX
This section will explain how we can monitor the Storm cluster using Java Management Extensions (JMX). The JMX is a set of specifications used to manage and monitor applications running in the JVM. We can collect or display Storm metrics, such as heap size, non-heap size, number of threads, number of loaded classes, heap and non-heap memory, virtual machine arguments, and managed objects on the JMX console. The following are the steps we need to perform to monitor the Storm cluster using JMX:
- We will need to add the following line in the
storm.yaml
file of each supervisor node to enable JMX on each of them:
supervisor.childopts: -verbose:gc -XX:+PrintGCTimeStamps - XX:+PrintGCDetails -Dcom.sun.management.jmxremote - Dcom.sun.management.jmxremote.ssl=false - Dcom.sun.management.jmxremote.authenticate=false - Dcom.sun.management.jmxremote.port=12346
Here, 12346
is the port number used to collect the supervisor JVM metrics through JMX.
- Add the following...