Using state change log merger
The StateChangeLogMerger
tool merges the state change logs from different brokers for easy posterior analysis. It is a tool for merging the log files from several brokers to rebuild a unified history of what happened.
Getting ready
For this recipe, Kafka must be installed, ZooKeeper running, brokers running, and some topics created on it. The topics should have produced some messages. It is better if there are several days' worth of broker information.
How to do it...
From the Kafka installation directory, run this command:
$ bin/kafka-run-class.sh kafka.tools.StateChangeLogMerger --log-regex /tmp/state-change.log* --partitions 0,1,2 --topic source-topic
How it works...
The StateChangeLogMerger
command takes the following parameters:
--end-time <String: end>
: This specifies the latest timestamp of state change entries to be merged injava.text.SimpleDateFormat
--logs <String: file1, file2, ...>
: This is used to specify a comma-separated list of state change...