Search icon CANCEL
Subscription
0
Cart icon
Your Cart (0 item)
Close icon
You have no products in your basket yet
Save more on your purchases! discount-offer-chevron-icon
Savings automatically calculated. No voucher code required.
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletter Hub
Free Learning
Arrow right icon
timer SALE ENDS IN
0 Days
:
00 Hours
:
00 Minutes
:
00 Seconds
Learn Apache Mesos
Learn Apache Mesos

Learn Apache Mesos: A beginner's guide to scalable cluster management and deployment

eBook
AU$14.99 AU$42.99
Paperback
AU$53.99
Subscription
Free Trial
Renews at AU$24.99p/m

What do you get with Print?

Product feature icon Instant access to your digital eBook copy whilst your Print order is Shipped
Product feature icon Paperback book shipped to your preferred address
Product feature icon Download this book in EPUB and PDF formats
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want
OR
Modal Close icon
Payment Processing...
tick Completed

Shipping Address

Billing Address

Shipping Methods
Table of content icon View table of contents Preview book icon Preview Book

Learn Apache Mesos

Setting up Mesos Single-Cluster Nodes

In this chapter, we will discuss some of the considerations for setting up a development environment. The minimum server is used to deploy Mesos components for development purposes.

Our intention here is to build a development environment for Mesos by using a Mesos single-cluster-node setup, along with installing and configuring Mesos components on a single node, in the following order:

  • Setting up servers on AWS
  • Adding the Mesosphere repository in CentOS
  • Installing a single instance of ZooKeeper
  • Installing Mesos master services
  • Installing Mesos slave services
  • Installing the Docker engine
  • Installing Marathon
  • Deploying a sample application
  • Enabling inbound traffic using security groups to access Mesos and the Marathon console

Setup of servers on AWS

To deploy Apache Mesos and the pertinent components, we need servers where we can install these components. So, in this module, we will work on creating EC2 instances on AWS.

To deploy Mesos on AWS, we should have a Virtual Private Cloud (VPC), a subnet, in order to launch our instances inside different subnets as per our requirements, a route table where our instances can communicate with each other, and an internet gateway for public access, and then we will create the EC2 instances. After the creation of EC2 instances, we will deploy our Mesos software and their components.

Before we start with EC2 instances, let's understand the architecture of our system. The following diagram shows the architecture in which we are working on AWS and creating a VPC. Now we will create the EC2 instance, which will have two Marathon servers and three Mesos master...

Adding a Mesosphere repository in CentOS

In order to add the mesosphere repository, run and install a command, as shown:

After this, install ZooKeeper with yum by running the sudo yum install mesosphere-zookeeper command. This will install ZooKeeper on CentOS:

We can see the mesosphere-zookeeper package with version 3.4.6 from the mesosphere repository, and the size is 2.8 MB.

This screenshot shows that the package has been installed:

Now, install the Mesos master and Mesos slave, as shown:

We can see the mesos package version 1.5 from the mesosphere repository, and the size is 76 MB.

Hence, this will download and install Mesos, which will comprise the Mesos master and slave service, as seen here:

Installing Docker Community Edition

The sudo yum-config-manager command will add a Docker repository in our CentOS, as seen in the following screenshot:

Run the sudo yum install docker-ce command:

Type yes, which will install Docker Community Edition:

Configuring ZooKeeper

Perform the following steps to configure ZooKeeper:

  1. Type cd /etc /mesos.
  2. Open the vi zk file. The following screenshot shows the default Mesos definition. This is the default ZooKeeper information. The line starts with zk and ends with /mesos, and in between, we will have the IP address and the ZooKeeper port:

  1. Replace this localhost with the host IP address by typing ifconfig in order to get the IP. As we have a standalone server, we will use the IP address that is highlighted here:
  1. Go to cd /etc /mesos and run sudo vi zk to replace the IP.
  2. Save the file. This completes the ZooKeeper connection information for Mesos.
  3. Map the unique ID by typing var/lib/zookeeper and cat myid.
  4. It has defined 1. As we have a standalone system, we will keep ID 1 for this server only.
If you don't have this myid file, you need to create it by typing myid, and inside...

ZooKeeper

To start ZooKeeper, type sudo service zookeeper start. Check the status:

You can see status -l has more information:

Run sudo service mesos-master start, and see the status:

You can also add -l to get more information:

In order to access the console, here is the Mesos-master server and the public IP is 34.237.145.106 port is 5050. But we won't be able to access this as we need to enable the traffic and security group.

To do so, check the Security groups, which is mesos. We need to add a rule and input 5050 as Port Range, in Inbound | Edit. Where, we will consider the source as Anywhere but you should define your IP or your custom IP range and save it.

Now let's go and refresh our page(34.237.145.106:5050). We can see that we are able to access Mesos:

In this way, you can enable the inbound rule for your Mesos master server.

...

Installation of the Marathon framework

The following are the steps to install the Marathon package on the EC2 instance:

  1. The following screenshot shows the Marathon server in which we will install the package and add the Mesosphere repository to install the Marathon package:

  1. Install the Marathon by run the following command:
  1. Perform the sudo rpm -qa | grep marathon command, which will show the Marathon package installed:

Configuration of Marathon

We need to perform two configurations where we will define the Mesos master-related information and ZooKeeper information.

The following are the steps to work on the configuration of Marathon:

  1. Edit the marathon.service file by opening the file that is inside /etc/systemd...

Mesos services

To check the Mesos web page, use the name on the local desktop. There will be no agent activity, so we will start our Mesos slave by typing sudo service mesos-slave start:

Check the status with sudo service mesos-slave status command. It will be in running state. Next, check the Mesos console. Click the Agents tab, and you will see that we have activated the agent that is running on the Mesos host. Hence, the host, CPUs, memory, and disk space are visible, which are registered:

Click on the Frameworks tab, and then you will see which frameworks are available via the Mesos console:

Deploying the Marathon application

To deploy the sample nginx application, carry out the following steps:

  1. Click on Create Application...

Summary

In this chapter, you learned how to create a VPC as well as multiple subnets in different availability zones. We also created a route table so traffic can flow between them, then we created an internet gateway to give internet access to our instances. We learned how to create an EC2 instance inside our VPC and subnet. We created multiple instances and different subnets to achieve high availability and reliability.

You also saw that you can connect to an EC2 instance in two ways: by using PuTTY, or by converting them into a PPK file and using PuTTY to connect to your instances and next using SSH. If you have Apache, you can use SSH to connect to your instances.

In the next chapter, we will see how to install Mesos and our required components on all these servers.

Left arrow icon Right arrow icon
Download code icon Download Code

Key benefits

  • Create clusters and perform scheduling, logging, and resource administration with Mesos
  • Explore practical examples of managing complex clusters at scale with real-world data
  • Write native Mesos frameworks with Python

Description

Apache Mesos is an open source cluster manager that provides efficient resource isolation and sharing across distributed applications or frameworks. This book will help you build a strong foundation of Mesos' capabilities along with practical examples to support the concepts explained throughout the book. Learn Apache Mesos dives straight into how Mesos works. You will be introduced to the distributed system and its challenges and then learn how you can use Mesos and its framework to solve data problems. You will also gain a full understanding of Mesos' internal mechanisms and get equipped to use Mesos and develop applications. Furthermore, this book lets you explore all the steps required to create highly available clusters and build your own Mesos frameworks. You will also cover application deployment and monitoring. By the end of this book, you will have learned how to use Mesos to make full use of machines and how to simplify data center maintenance.

Who is this book for?

This book is for DevOps and data engineers and administrators who work with large data clusters. You’ll also find this book useful if you have experience working with virtualization, databases, and platforms such as Hadoop and Spark. Some experience in database administration and design will help you get the most out of this book.

What you will learn

  • Deploy and monitor a Mesos cluster
  • Set up servers on AWS to deploy Mesos components
  • Explore Mesos resource scheduling and the allocation module
  • Deploy Docker-based services and applications using Mesos Marathon
  • Configure and use SSL to protect crucial endpoints of your Mesos cluster
  • Debug and troubleshoot services and workloads on a Mesos cluster
Estimated delivery fee Deliver to Australia

Economy delivery 7 - 10 business days

AU$19.95

Product Details

Country selected
Publication date, Length, Edition, Language, ISBN-13
Publication date : Oct 31, 2018
Length: 248 pages
Edition : 1st
Language : English
ISBN-13 : 9781789137385
Languages :
Tools :

What do you get with Print?

Product feature icon Instant access to your digital eBook copy whilst your Print order is Shipped
Product feature icon Paperback book shipped to your preferred address
Product feature icon Download this book in EPUB and PDF formats
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want
OR
Modal Close icon
Payment Processing...
tick Completed

Shipping Address

Billing Address

Shipping Methods
Estimated delivery fee Deliver to Australia

Economy delivery 7 - 10 business days

AU$19.95

Product Details

Publication date : Oct 31, 2018
Length: 248 pages
Edition : 1st
Language : English
ISBN-13 : 9781789137385
Languages :
Tools :

Packt Subscriptions

See our plans and pricing
Modal Close icon
AU$24.99 billed monthly
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Simple pricing, no contract
AU$249.99 billed annually
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just AU$5 each
Feature tick icon Exclusive print discounts
AU$349.99 billed in 18 months
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just AU$5 each
Feature tick icon Exclusive print discounts

Frequently bought together


Stars icon
Total AU$ 197.97
Learn Apache Mesos
AU$53.99
Hands-On Software Architecture with Golang
AU$75.99
Getting Started with Kubernetes
AU$67.99
Total AU$ 197.97 Stars icon
Banner background image

Table of Contents

9 Chapters
Deploying Apache Mesos on AWS Chevron down icon Chevron up icon
Setting up Mesos Single-Cluster Nodes Chevron down icon Chevron up icon
Installation of Mesosphere Chevron down icon Chevron up icon
Apache Mesos Administration Chevron down icon Chevron up icon
Deploying Services on Mesos Cluster Chevron down icon Chevron up icon
Persistent Volumes Chevron down icon Chevron up icon
Securing Mesos Chevron down icon Chevron up icon
Managing Resources in Mesos Chevron down icon Chevron up icon
Another Book You May Enjoy Chevron down icon Chevron up icon
Get free access to Packt library with over 7500+ books and video courses for 7 days!
Start Free Trial

FAQs

What is the delivery time and cost of print book? Chevron down icon Chevron up icon

Shipping Details

USA:

'

Economy: Delivery to most addresses in the US within 10-15 business days

Premium: Trackable Delivery to most addresses in the US within 3-8 business days

UK:

Economy: Delivery to most addresses in the U.K. within 7-9 business days.
Shipments are not trackable

Premium: Trackable delivery to most addresses in the U.K. within 3-4 business days!
Add one extra business day for deliveries to Northern Ireland and Scottish Highlands and islands

EU:

Premium: Trackable delivery to most EU destinations within 4-9 business days.

Australia:

Economy: Can deliver to P. O. Boxes and private residences.
Trackable service with delivery to addresses in Australia only.
Delivery time ranges from 7-9 business days for VIC and 8-10 business days for Interstate metro
Delivery time is up to 15 business days for remote areas of WA, NT & QLD.

Premium: Delivery to addresses in Australia only
Trackable delivery to most P. O. Boxes and private residences in Australia within 4-5 days based on the distance to a destination following dispatch.

India:

Premium: Delivery to most Indian addresses within 5-6 business days

Rest of the World:

Premium: Countries in the American continent: Trackable delivery to most countries within 4-7 business days

Asia:

Premium: Delivery to most Asian addresses within 5-9 business days

Disclaimer:
All orders received before 5 PM U.K time would start printing from the next business day. So the estimated delivery times start from the next day as well. Orders received after 5 PM U.K time (in our internal systems) on a business day or anytime on the weekend will begin printing the second to next business day. For example, an order placed at 11 AM today will begin printing tomorrow, whereas an order placed at 9 PM tonight will begin printing the day after tomorrow.


Unfortunately, due to several restrictions, we are unable to ship to the following countries:

  1. Afghanistan
  2. American Samoa
  3. Belarus
  4. Brunei Darussalam
  5. Central African Republic
  6. The Democratic Republic of Congo
  7. Eritrea
  8. Guinea-bissau
  9. Iran
  10. Lebanon
  11. Libiya Arab Jamahriya
  12. Somalia
  13. Sudan
  14. Russian Federation
  15. Syrian Arab Republic
  16. Ukraine
  17. Venezuela
What is custom duty/charge? Chevron down icon Chevron up icon

Customs duty are charges levied on goods when they cross international borders. It is a tax that is imposed on imported goods. These duties are charged by special authorities and bodies created by local governments and are meant to protect local industries, economies, and businesses.

Do I have to pay customs charges for the print book order? Chevron down icon Chevron up icon

The orders shipped to the countries that are listed under EU27 will not bear custom charges. They are paid by Packt as part of the order.

List of EU27 countries: www.gov.uk/eu-eea:

A custom duty or localized taxes may be applicable on the shipment and would be charged by the recipient country outside of the EU27 which should be paid by the customer and these duties are not included in the shipping charges been charged on the order.

How do I know my custom duty charges? Chevron down icon Chevron up icon

The amount of duty payable varies greatly depending on the imported goods, the country of origin and several other factors like the total invoice amount or dimensions like weight, and other such criteria applicable in your country.

For example:

  • If you live in Mexico, and the declared value of your ordered items is over $ 50, for you to receive a package, you will have to pay additional import tax of 19% which will be $ 9.50 to the courier service.
  • Whereas if you live in Turkey, and the declared value of your ordered items is over € 22, for you to receive a package, you will have to pay additional import tax of 18% which will be € 3.96 to the courier service.
How can I cancel my order? Chevron down icon Chevron up icon

Cancellation Policy for Published Printed Books:

You can cancel any order within 1 hour of placing the order. Simply contact customercare@packt.com with your order details or payment transaction id. If your order has already started the shipment process, we will do our best to stop it. However, if it is already on the way to you then when you receive it, you can contact us at customercare@packt.com using the returns and refund process.

Please understand that Packt Publishing cannot provide refunds or cancel any order except for the cases described in our Return Policy (i.e. Packt Publishing agrees to replace your printed book because it arrives damaged or material defect in book), Packt Publishing will not accept returns.

What is your returns and refunds policy? Chevron down icon Chevron up icon

Return Policy:

We want you to be happy with your purchase from Packtpub.com. We will not hassle you with returning print books to us. If the print book you receive from us is incorrect, damaged, doesn't work or is unacceptably late, please contact Customer Relations Team on customercare@packt.com with the order number and issue details as explained below:

  1. If you ordered (eBook, Video or Print Book) incorrectly or accidentally, please contact Customer Relations Team on customercare@packt.com within one hour of placing the order and we will replace/refund you the item cost.
  2. Sadly, if your eBook or Video file is faulty or a fault occurs during the eBook or Video being made available to you, i.e. during download then you should contact Customer Relations Team within 14 days of purchase on customercare@packt.com who will be able to resolve this issue for you.
  3. You will have a choice of replacement or refund of the problem items.(damaged, defective or incorrect)
  4. Once Customer Care Team confirms that you will be refunded, you should receive the refund within 10 to 12 working days.
  5. If you are only requesting a refund of one book from a multiple order, then we will refund you the appropriate single item.
  6. Where the items were shipped under a free shipping offer, there will be no shipping costs to refund.

On the off chance your printed book arrives damaged, with book material defect, contact our Customer Relation Team on customercare@packt.com within 14 days of receipt of the book with appropriate evidence of damage and we will work with you to secure a replacement copy, if necessary. Please note that each printed book you order from us is individually made by Packt's professional book-printing partner which is on a print-on-demand basis.

What tax is charged? Chevron down icon Chevron up icon

Currently, no tax is charged on the purchase of any print book (subject to change based on the laws and regulations). A localized VAT fee is charged only to our European and UK customers on eBooks, Video and subscriptions that they buy. GST is charged to Indian customers for eBooks and video purchases.

What payment methods can I use? Chevron down icon Chevron up icon

You can pay with the following card types:

  1. Visa Debit
  2. Visa Credit
  3. MasterCard
  4. PayPal
What is the delivery time and cost of print books? Chevron down icon Chevron up icon

Shipping Details

USA:

'

Economy: Delivery to most addresses in the US within 10-15 business days

Premium: Trackable Delivery to most addresses in the US within 3-8 business days

UK:

Economy: Delivery to most addresses in the U.K. within 7-9 business days.
Shipments are not trackable

Premium: Trackable delivery to most addresses in the U.K. within 3-4 business days!
Add one extra business day for deliveries to Northern Ireland and Scottish Highlands and islands

EU:

Premium: Trackable delivery to most EU destinations within 4-9 business days.

Australia:

Economy: Can deliver to P. O. Boxes and private residences.
Trackable service with delivery to addresses in Australia only.
Delivery time ranges from 7-9 business days for VIC and 8-10 business days for Interstate metro
Delivery time is up to 15 business days for remote areas of WA, NT & QLD.

Premium: Delivery to addresses in Australia only
Trackable delivery to most P. O. Boxes and private residences in Australia within 4-5 days based on the distance to a destination following dispatch.

India:

Premium: Delivery to most Indian addresses within 5-6 business days

Rest of the World:

Premium: Countries in the American continent: Trackable delivery to most countries within 4-7 business days

Asia:

Premium: Delivery to most Asian addresses within 5-9 business days

Disclaimer:
All orders received before 5 PM U.K time would start printing from the next business day. So the estimated delivery times start from the next day as well. Orders received after 5 PM U.K time (in our internal systems) on a business day or anytime on the weekend will begin printing the second to next business day. For example, an order placed at 11 AM today will begin printing tomorrow, whereas an order placed at 9 PM tonight will begin printing the day after tomorrow.


Unfortunately, due to several restrictions, we are unable to ship to the following countries:

  1. Afghanistan
  2. American Samoa
  3. Belarus
  4. Brunei Darussalam
  5. Central African Republic
  6. The Democratic Republic of Congo
  7. Eritrea
  8. Guinea-bissau
  9. Iran
  10. Lebanon
  11. Libiya Arab Jamahriya
  12. Somalia
  13. Sudan
  14. Russian Federation
  15. Syrian Arab Republic
  16. Ukraine
  17. Venezuela