Explore Products

Best Sellers

New Releases

Books

Videos

Audiobooks

Learning Hub

Conferences

Free Learning

You're reading from Implementing Cloud Design Patterns for AWS Solutions and design ideas for solving system design problems

Product type Paperback

Published in Apr 2019

Publisher Packt

ISBN-13 9781789136203

Length 274 pages

Edition 2nd Edition

Tools

AWS

Concepts

Design Patterns

Authors (4):

Clive Harber

Sean Keery

Rick Farmer

Marcus Young

View More author details

Table of Contents (18) Chapters

Preface

1. Section 1: The Basics

2. Introduction to Amazon Web Services FREE CHAPTER

3. Core Services - Building Blocks for Your Product

4. Availability Patterns - Understanding Your Needs

5. Security - Ensuring the Integrity of Your Systems

6. Section 2: DevOps Patterns

7. Continuous Deployment - Introducing New Features with Minimal Risk

8. Ephemeral Environments - Sandboxes for Experiments

9. Operation and Maintenance - Keeping Things Running at Peak Performance

10. Application Virtualization - Using Cloud Native Patterns for Your Workloads

11. Antipatterns - Avoiding Counterproductive Solutions

12. Section 3: Persistence Patterns

13. Databases - Identifying Which Type Fits Your Needs

14. Data Processing - Handling Your Data Transformation

15. Observability - Understanding How Your Products Are Behaving

16. Anti-Patterns - Bypassing Inferior Options

17. Other Books You May Enjoy

Leave a review - let other readers know what you think

Event stream processing

Event stream processing can happen in a number of ways on AWS. One of the ways—Kinesis—we will cover separately. We will discuss using Elastic MapReduce here.

Elastic MapReduce is capable of using several different types of processing engines: Hadoop, Apache Spark, HBase, Presto, and Apache Flink. All of these engines are used for processing large amounts of data: some, such as Spark and Flink, are for real-time data processing, and Hadoop is for batch processing and so much more.

Standard EMR has already been covered in a previous chapter.

Using Flink (or another engine) via Terraform is as easy as changing the application's array content, as shown in the following block:

resource "aws_emr_cluster" "cluster" {
  name = "emr-test-arn"
  release_label = "emr-4.6.0"
  applications = ["Flink&quot...

The rest of the chapter is locked

A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.

Unlock this book and the full library FREE for 7 days

Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of

Start free trial

Renews at $19.99/month. Cancel anytime

Authors (4)

Keery

Sean Keery began hacking obscure video game systems at the age of 13. Sean then developed interpersonal skills while teaching snowboarding. Nowadays, Cloud Foundry, choreography, containers and plenty of .io. Cluster deployments, IaaS independence, and his studies for a master's in data science keep Sean occupied. The daily commute is filled with podcasts and chipmunk bunny hops. Some family time, spicy food, a good book, and wrecking the latest toys keep Sean busy at home.

See other products by Keery

Rick Farmer

Rick Farmer is one of the founders and a leader of the Pivotal Cloud Foundry Solutions enterprise consulting and delivery team at Pivotal. Over the last two decades, he established a track record of navigating complex organizational technology and services to deliver breathtaking results for mission-critical initiatives at over 70 of the world's most recognizable companies and government entities. Many of the engagements he has anchored have won various personal and project awards. Rick unlocks innovation and business value using Cloud Foundry to inject enterprise agility into even the most challenging environments by aligning digital transformation, technical and business opportunities. He enjoys speaking at conferences on subjects ranging from Cloud Foundry to Data Science to Digital Transformation to Agility in the Enterprise. Since 1997, Rick has surfed tropical events hitting the Texas Gulf Coast. He has a data science visualization project inducted into the Visualization Hall of Fame at the Harvard School of Engineering and Applied Sciences.

See other products by Rick Farmer

Young

Marcus Young obtained a degree in computer science and mathematics before getting involved in system administration and DevOps. He currently works in software automation using open source tools and technologies. His hobbies include playing ice hockey and brewing homebrew beer. He also enjoys hardware projects based on microcontrollers and single-board computers.

See other products by Young

Harber

Clive Harber has been programming computers since he was 13, when Commodore Basic was all the rage and the internet, as an idea, was something that was only just starting to appear in films such as WarGames. Fast-forward a decade, he gained a master's degree in chemical engineering from University of Wales, Swansea, which he used briefly in a stint when he worked in a semi-conductor foundry making microchips. Not being totally satisfied with this, he decided to change fields and learn how to write stuff for the internet. Now, he runs his own consultancy, Distorted Thinking, providing services to organizations that find themselves in digital transition, whether that's software changes or infrastructure to cloud service migration.

See other products by Harber