Elasticsearch 5.x introduces a set of powerful functionalities that target the problems that arise during ingestion of documents via the ingest node.
In Chapter 1, Getting Started, we discussed that the Elasticsearch node can be master, data, or ingest; the idea to split the ingest component from the others is to create a more stable cluster due to problems that can arise when preprocessing documents.
To create a more stable cluster, the ingest nodes should be isolated by the master nodes (and possibly also from the data ones) in the event that some problems may occur, such as a crash due to an attachment plugin and high loads due to complex type manipulation.
The ingestion node can replace a Logstash installation in simple scenarios.
In this chapter, we will cover the following recipes:
- Pipeline definition
- Inserting an ingest pipeline
- Getting ...
