You're reading from Datadog Cloud Monitoring Quick Start Guide Proactively create dashboards, write scripts, manage alerts, and monitor containers using Datadog

Product type Paperback

Published in Jun 2021

Publisher Packt

ISBN-13 9781800568730

Length 318 pages

Edition 1st Edition

Tools

Datadog

Concepts

Application Monitoring

Author (1):

Thomas Kurian Theakanath

View More author details

Table of Contents (19) Chapters

Preface

1. Section 1: Getting Started with Datadog

2. Chapter 1: Introduction to Monitoring FREE CHAPTER

3. Chapter 2: Deploying the Datadog Agent

4. Chapter 3: The Datadog Dashboard

5. Chapter 4: Account Management

6. Chapter 5: Metrics, Events, and Tags

7. Chapter 6: Monitoring Infrastructure

8. Chapter 7: Monitors and Alerts

9. Section 2: Extending Datadog

10. Chapter 8: Integrating with Platform Components

11. Chapter 9: Using the Datadog REST API

12. Chapter 10: Working with Monitoring Standards

13. Chapter 11: Integrating with Datadog

14. Section 3: Advanced Monitoring

15. Chapter 12: Monitoring Containers

16. Chapter 13: Managing Logs Using Datadog

17. Chapter 14: Miscellaneous Monitoring Topics

18. Other Books You May Enjoy

Processing logs

Once the logs are collected by Datadog, they will be available on Log Explorer to view and search. The logs in the structured JSON format are processed by Datadog automatically. The unstructured logs can be processed further and analytical insights extracted. Datadog uses Pipelines and Processors to process the incoming logs.

To view the pipelines available, open the Logs | Configuration menu option from the main menu. The pipelines are listed under the Pipelines tab, as shown in the following sample screenshot:

Figure 13.2 – Pipelines for log processing

A pipeline can be fed with a subset of logs and it uses a set of processors that are executed sequentially for processing the logs. There are predefined pipelines available based on the Datadog integrations currently in use, and they are enabled if related logs are collected by Datadog. It is also possible to set up custom pipelines to meet specific indexing requirements.

In the...