0

Explore Products

Best Sellers

New Releases

Books

Videos

Audiobooks

Free Learning

Apache Kafka Series - Kafka Monitoring and Operations

Apache Kafka Series - Kafka Monitoring and Operations: Get hands-on with Kafka monitoring setup with Prometheus and Grafana, Kafka operations and Kafka cluster upgrades Setup in AWS.

Stéphane Maarek

zł221.99

Video Jan 2019 5hrs 3mins 1st Edition

Stéphane Maarek

zł221.99

Video Jan 2019 5hrs 3mins 1st Edition

What do you get with a video?

Download this video in MP4 format

Access this title in our online reader with advanced features

DRM FREE - Read whenever, wherever and however you want

View table of contents Download Code

Key benefits

• Set up a multi-broker Kafka cluster in no time in AWS (using CloudFormation)
• Set up administration tools such as Kafka Manager, ZooNavigator, and LinkedIn's Kafka Monitor
• Set up monitoring using Grafana and Prometheus

Description

This course helps you learn Kafka administration, Kafka monitoring, Kafka operations, and Kafka upgrades. It covers the following topics: Administration for Apache Kafka o Setup UI tools such as Kafka Manager, Zoo Navigator, and Kafka Monitor to get a full view of your cluster o Understand basic operations you can perform with these tools Monitoring for Apache Kafka o A Kafka that is not monitored is a ticking time-bomb. o Set up proper monitoring for Kafka and Zookeeper o Store your metrics in Prometheus and visualize them in Grafana Operations for Apache Kafka o Perform the most common and difficult operations in your Apache Kafka cluster o Roll-restart your brokers in only one command o Update Kafka configurations safely with no downtime o Rebalance partitions and change the replication factor of your topics o Add, replace, and remove brokers. Upgrades for Apache Kafka o Understand the subtlety of upgrading a Kafka cluster o Step-by-step explanations on upgrading a cluster with no downtime All the code files are placed at https://github.com/PacktPublishing/Apache-Kafka-Series---Kafka-Monitoring-and-Operations

Who is this book for?

Kafka administrators who want to learn how to set up monitoring, perform Kafka operations, and upgrade a Kafka cluster.

What you will learn

• Learn how to perform a safe and automated roll-restart of Kafka brokers
• Update broker configurations in a safe way
• Rebalance partitions in a Kafka cluster
• Increase and decrease the replication factor of topics
• Add a broker to a Kafka cluster
• Service and replace a broker in a Kafka cluster
• Remove a broker in a Kafka cluster
• Install Command Line Interface (CLI) tools to automate workflows
• Upgrade a Kafka cluster with no downtime

What do you get with a video?

Download this video in MP4 format

Access this title in our online reader with advanced features

DRM FREE - Read whenever, wherever and however you want

Product Details

Publication date : Jan 24, 2019

Length: 5hrs 3mins

Edition : 1st

Language : English

ISBN-13 : 9781838558765

Vendor :

Apache

Category :

Programming

Concepts :

Application Monitoring

Tools :

AWS

Frequently bought together

Data Stream Development with Apache Spark, Kafka, and Spring Boot

Data Stream Development with Apache Spark, Kafka, and Spring Boot

Nov 2018 7hrs 51mins

Video

zł556.99

Apache Kafka Series - Kafka Monitoring and Operations

Apache Kafka Series - Kafka Monitoring and Operations

Jan 2019 5hrs 3mins

Video

zł221.99

Apache Kafka Quick Start Guide

Apache Kafka Quick Start Guide

Dec 2018 186 pages

eBook

zł59.99 ~~zł106.99~~

Total zł 912.97

Data Stream Development with Apache Spark, Kafka, and Spring Boot

zł556.99

Apache Kafka Series - Kafka Monitoring and Operations

zł221.99

Apache Kafka Quick Start Guide

zł133.99

Total zł 912.97

Table of Contents

7 Chapters

Course Overview and Introduction

Course Overview

Kafka Quick Setup in AWS

What is AWS CloudFormation

Target Architecture and Setup

[Hands-On] Deploy Zookeeper Using CloudFormation

[Hands-On] Deploy Kafka Using CloudFormation

[Hands-On] Overview of our Zookeeper Cluster

[Hands-On] Overview of our Kafka Cluster

[Hands-On] Stopping the Kafka Cluster

Kafka Administration Setup

[Hands-On] Overview and Setup of Monitoring Machine

[Hands-On] Setup Zoonavigator

[Hands-On] Setup Kafka Manager

[Hands-On] Setup Kafka Monitor

Kafka Monitoring Setup: Grafana + Prometheus

Overview of Monitoring

[Hands-On] Setting up Prometheus + Kafka Broker 1

[Solution] Broker 2 & 3 Prometheus Setup

[Solution] Zookeeper & Prometheus Setup

[Hands-On] Setup Grafana on Administration Server

[Hands-On] Setup Kafka Dashboard on Grafana

Important Metrics to monitor

[Hands-On] Adding Graphs to Grafana

[Solution] Adding more graphs to Grafana

[Hands-On] Observing Grafana when we kill a broker

Considerations to make the setup production-ready

Kafka Operations

[Hands-On] Install Jolokia Agent on Broker 1

[[Solution] Install Jolokia on Broker 2 & 3

[Hands-On] Install Rolling Restart Script

[Hands-On] Run Roll Restart Script

[Hands-On] Updating Configurations 1st method (rolling restart)

[Hands-On] Updating Configurations 2nd method (kafka-configs command)

[Hands-On] Rebalancing Partitions using plain commands and JSON

[Hands-On] Rebalancing Partitions using Kafka Manager

[Hands-On] Rebalancing Partitions using LinkedIn tools

[Hands-On] Increasing Replication Factor using plain commands and JSON

[Hands-On] Increasing Replication Factor using LinkedIn tools

[Hands-On] Adding Broker 4 using CloudFormation

[Solution] Moving partitions over to Broker 4 using the CLI tools

[Hands-On] Replacing a Broker keeping EBS Volume

[Hands-On] Replacing a Broker losing an EBS Volume

Removing a Broker Overview

[Solution] Remove Broker 4

Kafka Cluster Upgrade

Upgrading a Kafka Cluster Overview

[Advanced] Zero Copy, Up and Down Conversions

[Hands-On] Kafka Broker Upgrade Step 1

[Hands-On] Kafka Broker Upgrade Step 2

[Hands-On] Kafka Broker Upgrade Step 3

[Hands-On] Kafka Broker Upgrade Step 4

[Hands-On] Kafka Broker Upgrade Step 5

Next Steps

Cleaning up AWS

Next Steps & Congratulations!

Recommendations for you

Composing Software

Composing Software

Sep 2024 238 pages

eBook

zł59.99 ~~zł138.99~~

Bare-Metal Embedded C Programming

Bare-Metal Embedded C Programming

Sep 2024 438 pages

eBook

zł59.99 ~~zł135.99~~

TradeStation EasyLanguage for Algorithmic Trading

TradeStation EasyLanguage for Algorithmic Trading

Sep 2024 282 pages

eBook

zł59.99 ~~zł129.99~~

Technical Program Manager's Handbook

Technical Program Manager's Handbook

Sep 2024 368 pages

eBook

zł59.99 ~~zł135.99~~

Everyday data structures

Everyday data structures

Mar 2017 344 pages

eBook

zł59.99 ~~zł158.99~~

ChatGPT and Prompt Engineering for Software Development

ChatGPT and Prompt Engineering for Software Development

Jul 2023 4hrs 23mins

Video

zł221.99

Learn Java 17 Programming

Learn Java 17 Programming

Jul 2022 748 pages

eBook

zł59.99 ~~zł145.99~~

Learn Python Programming

Learn Python Programming

Jun 2018 508 pages

eBook

zł59.99 ~~zł148.99~~

Software Architecture Patterns for Serverless Systems

Software Architecture Patterns for Serverless Systems

Feb 2024 488 pages

eBook

zł59.99 ~~zł187.99~~

Mastering Python Design Patterns

Mastering Python Design Patterns

May 2024 296 pages

eBook

zł59.99 ~~zł129.99~~

People who bought this also bought

Domain-Driven Design with Golang

Domain-Driven Design with Golang

Dec 2022 204 pages

eBook

zł59.99 ~~zł145.99~~

Template Metaprogramming with C++

Template Metaprogramming with C++

Aug 2022 480 pages

eBook

zł59.99 ~~zł151.99~~

The Python Workshop Second Edition

The Python Workshop Second Edition

Nov 2022 600 pages

eBook

zł59.99 ~~zł167.99~~

Event-Driven Architecture in Golang

Event-Driven Architecture in Golang

Nov 2022 384 pages

eBook

zł59.99 ~~zł161.99~~

50 Algorithms Every Programmer Should Know

50 Algorithms Every Programmer Should Know

Sep 2023 538 pages

eBook

zł59.99 ~~zł161.99~~

About the author

Stéphane Maarek

Stéphane Maarek

Stéphane Maarek is a solutions architect, consultant, and software developer who has a particular interest in all things related to big data and analytics. He is also a bestseller instructor on Udemy for his courses on Apache Kafka, Apache NiFi, and AWS Lambda. He loves Apache Kafka and regularly contributes to the Apache Kafka project. Stéphane has also written a guest blog post that was featured on the Confluent website, the company behind Apache Kafka. He is also an AWS Certified Solutions Architect and has many years of experience with technologies such as Apache Kafka, Apache NiFi, Apache Spark, Hadoop, PostgreSQL, Tableau, Spotfire, Docker, Ansible, and more.

See other products by Stéphane Maarek

FAQs

How can I download a video package for offline viewing?

Login to your account at Packtpub.com.
Click on "My Account" and then click on the "My Videos" tab to access your videos.
Click on the "Download Now" link to start your video download.

How can I extract my video file?

All modern operating systems ship with ZIP file extraction built in. If you'd prefer to use a dedicated compression application, we've tested WinRAR / 7-Zip for Windows, Zipeg / iZip / UnRarX for Mac and 7-Zip / PeaZip for Linux. These applications support all extension files.

How can I get help and support around my video package?

If your video course doesn't give you what you were expecting, either because of functionality problems or because the content isn't up to scratch, please mail customercare@packt.com with details of the problem. In addition, so that we can best provide the support you need, please include the following information for our support team.

Video
Format watched (HTML, MP4, streaming)
Chapter or section that issue relates to (if relevant)
System being played on
Browser used (if relevant)
Details of support

Why can’t I download my video package?

In the even that you are having issues downloading your video package then please follow these instructions:

Disable all your browser plugins and extensions: Some security and download manager extensions can cause issues during the download.
Download the video course using a different browser: We've tested downloads operate correctly in current versions of Chrome, Firefox, Internet Explorer, and Safari.