Summary

In this chapter, we looked at how to get data from different sources into Kibana, and then perform data analytics and visualization on it. We covered different ways to get data in Elasticsearch. We saw how Beats, a lightweight data shipper, can be installed on a server to send data. Under Beats, we covered Filebeat, which reads file data, such as Apache logs, system logs, and application logs, and can send them to Elasticsearch directly or using Logstash. Then we configured Metricbeat to read system metrics, such as CPU usage, memory usage, MySQL metrics, and then Packetbeat, using which we can read network packet data to get insights from it.

We covered how Logstash can be used to get data and apply filters before sending it to Elasticsearch. In the first section, we covered how to fetch CSV data using Logstash, where we passed a CSV file as input and specified the columns...