You're reading from Getting Started with Elastic Stack 8.0 Run powerful and scalable data platforms to search, observe, and secure your organization

Product type Paperback

Published in Mar 2022

Publisher Packt

ISBN-13 9781800569492

Length 474 pages

Edition 1st Edition

Tools

Elasticsearch

Concepts

Enterprise Search

Author (1):

Asjad Athick

View More author details

Table of Contents (18) Chapters

Preface

1. Section 1: Core Components

2. Chapter 1: Introduction to the Elastic Stack FREE CHAPTER

3. Chapter 2: Installing and Running the Elastic Stack

4. Section 2: Working with the Elastic Stack

5. Chapter 3: Indexing and Searching for Data

6. Chapter 4: Leveraging Insights and Managing Data on Elasticsearch

7. Chapter 5: Running Machine Learning Jobs on Elasticsearch

8. Chapter 6: Collecting and Shipping Data with Beats

9. Chapter 7: Using Logstash to Extract, Transform, and Load Data

10. Chapter 8: Interacting with Your Data on Kibana

11. Chapter 9: Managing Data Onboarding with Elastic Agent

12. Section 3: Building Solutions with the Elastic Stack

13. Chapter 10: Building Search Experiences Using the Elastic Stack

14. Chapter 11: Observing Applications and Infrastructure Using the Elastic Stack

15. Chapter 12: Security Threat Detection and Response Using the Elastic Stack

16. Chapter 13: Architecting Workloads on the Elastic Stack

17. Other Books You May Enjoy

Looking at pipelines for real-world data-processing scenarios

This section will explore a number of real-world ETL scenarios and the corresponding Logstash pipelines that can be used to implement them.

The full datasets used and the pipeline configuration files can be found in the code repository for the book.

Loading data from CSV files into Elasticsearch

Comma-Separated Value (CSV) files are a commonly used file format and can be easily generated by a range of source systems and tools. We will explore how a dataset containing taxi trip details from the city of Chicago can be parsed and loaded into Elasticsearch for analysis.

Navigate to Chapter7/processing-csv-files in the code repository and explore the chicago-taxi-data.csv file. The first row contains header information, indicating what information each column contains. The following screenshot is an extract of some of the key fields in the file:

Figure 7.4 – An overview of the CSV file...