Introducing Logstash
Logstash is an Elastic product built on Java that can provide multiple pipelines to move data into Elasticsearch via input and output plugins. Logstash uses various inputs to collect data, send it into Elasticsearch, and even enrich it along the way.
Input plugins
Input plugins allow specific datasets to be consumed and processed by Logstash. There are a tremendous number of plugins available for Logstash, and they are available for free and have varying levels of complexity.
Some of the most common plugins are the Syslog plugin, which reads Syslog events over the network, the Kafka plugin, which reads events from a Kafka topic, and the SNMP plugin, which polls network devices using Simple Network Management Protocol (SNMP).
Check out the available input plugins here: https://www.elastic.co/guide/en/logstash/current/input-plugins.html.
Filter plugins
As we mentioned, Logstash has the ability to apply filters to data as it travels through the pipeline...