The Elastic Stack
The Elastic Stack is a set of tightly integrated products that are well suited to address the requirements of a DE lab. The Elastic Stack includes the following components:
- Beats: A data shipper that is used to collect data from an endpoint and forward it to Elasticsearch or Logstash for pre-processing. Different packages exist for collecting different types of data from endpoints. While Beats is a core component of the Elastic Stack, in this book, we will use Elastic Agent to forward data from endpoints to Elasticsearch.
- Logstash: A powerful tool for transforming data and forwarding it to different destination systems. It offers a high degree of control over re-shaping data and has plugins that support forwarding data to a significant variety of destinations.
- Elasticsearch: This is the data storage component. While primarily designed for searching, it has evolved to become a capable data analysis engine.
- Kibana: This is the Elasticsearch frontend...