Search icon CANCEL
Subscription
0
Cart icon
Your Cart (0 item)
Close icon
You have no products in your basket yet
Save more on your purchases! discount-offer-chevron-icon
Savings automatically calculated. No voucher code required.
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletter Hub
Free Learning
Arrow right icon
timer SALE ENDS IN
0 Days
:
00 Hours
:
00 Minutes
:
00 Seconds
MLOps with Red Hat OpenShift
MLOps with Red Hat OpenShift

MLOps with Red Hat OpenShift: A cloud-native approach to machine learning operations

Arrow left icon
Profile Icon Ross Brigoli Profile Icon Faisal Masood
Arrow right icon
€33.99
Full star icon Full star icon Full star icon Full star icon Full star icon 5 (2 Ratings)
Paperback Jan 2024 238 pages 1st Edition
eBook
€8.99 €26.99
Paperback
€33.99
Subscription
Free Trial
Renews at €18.99p/m
Arrow left icon
Profile Icon Ross Brigoli Profile Icon Faisal Masood
Arrow right icon
€33.99
Full star icon Full star icon Full star icon Full star icon Full star icon 5 (2 Ratings)
Paperback Jan 2024 238 pages 1st Edition
eBook
€8.99 €26.99
Paperback
€33.99
Subscription
Free Trial
Renews at €18.99p/m
eBook
€8.99 €26.99
Paperback
€33.99
Subscription
Free Trial
Renews at €18.99p/m

What do you get with Print?

Product feature icon Instant access to your digital eBook copy whilst your Print order is Shipped
Product feature icon Paperback book shipped to your preferred address
Product feature icon Download this book in EPUB and PDF formats
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want
Product feature icon AI Assistant (beta) to help accelerate your learning
OR
Modal Close icon
Payment Processing...
tick Completed

Shipping Address

Billing Address

Shipping Methods
Table of content icon View table of contents Preview book icon Preview Book

MLOps with Red Hat OpenShift

Introduction to MLOps and OpenShift

If you have chosen to read this book, chances are that you have a background in the machine learning (ML) domain. The primary purpose of this book is to show you how Red Hat OpenShift provides the basis for developing, deploying, and monitoring your models in production. In addition, you will learn about different components of the OpenShift ecosystem and how you can weave them together to build a path toward automating the life cycle of your ML project. You will also learn how to leverage Red Hat OpenShift Data Science and its partner components.

Finally, you will see how the approaches presented in this book can help your organization scale its ML initiatives through MLOps practices.

This first chapter focuses on giving you the basic definitions of the concepts and the technologies involved in the Red Hat OpenShift ecosystem for machine learning.

This chapter will cover the following topics:

  • What is machine learning operations...

What is MLOps?

MLOps is a set of practices that aims to streamline the process of deploying and maintaining ML models in production environments. It involves integrating ML workflows with DevOps practices to ensure that ML models are tested, deployed, and monitored in a reliable and scalable manner.

MLOps involves collaboration between data scientists, ML engineers, software developers, and operations teams to create a continuous integration and delivery pipeline for ML models. This pipeline includes steps such as data preparation, model training, model testing, model deployment, and monitoring. MLOps also involves the use of automation, testing, and monitoring tools to ensure that models remain accurate, stable, and scalable over time.

Some common practices in MLOps include version control for models and data, experiment tracking, model validation, continuous integration and delivery, containerization of models, and monitoring of model performance and data drift.

So, what...

Introduction to OpenShift

Although this book is not about operationalizing the OpenShift platform, a basic introduction to the platform is helpful. In this section, you will learn about the core concepts of Kubernetes and OpenShift.

OpenShift is a complete application platform based on Kubernetes. It is also categorized as Enterprise Kubernetes. Kubernetes provides a solid foundation for container hosting and orchestration. Moreover, Kubernetes provides core functionalities, such as cluster-state management, where a reconcile loop makes sure that the cluster state and the desired state are in sync. Kubernetes also includes a set of APIs to interact with the cluster. Kubernetes is a great platform, but in reality, applications need much more than just the core services provided by Kubernetes.

Assume that you want to deploy a Python application on a Kubernetes cluster. Let’s assess what is required. First, you need to package your application as a container image. Secondly...

Understanding operators

In traditional organizations, specialized and dedicated teams were required to maintain applications and other software components such as databases, caches, and messaging components. Moreover, those teams were continuously observing the software ecosystem and doing specific things, such as taking backups for databases, upgrading and patching newer versions of software components, and more.

Operators in Kubernetes are like system administrators or human operators, continuously monitoring applications running on the Kubernetes environment and performing operational tasks associated with the specific component. In summary, an operator extends Kubernetes to automate the management of the complete life cycle of an application. For example, a PostgreSQL operator automates the database’s high availability, installation, patching, and backup abilities, to name a few. Many operators are available for various software components, such as databases, caches,...

Understanding how OpenShift supports MLOps

As you have seen, an application platform provides an opinionated way of running services on Kubernetes. An example of this is OpenShift, which provides Prometheus and Grafana as monitoring services. A similar approach is applied to the software required to run MLOps on OpenShift. Red Hat and its partners provide MLOps components on top of the OpenShift platform that provides the services for a complete ML platform. Using OpenShift, all the MLOps capabilities can be consistently deployed on-premises and on the cloud.

Just like DevOps, one of the primary objectives of MLOps is to bridge the gap between the engineers who are building the applications – or in this case, the data scientists and ML engineers who are developing ML models – and the operations team. To achieve this, we need to have a common platform where engineers and operators will meet. The best tool we have for this is containerization platforms. This allows both...

Red Hat OpenShift Data Science (RHODS)

In this section, you will explore the components that form the ML platform stack. The technology stack is a combination of Red Hat components, Red Hat partner components, and open source software. It’s called RHODS, and it’s Red Hat’s solution for running data science and ML workloads on OpenShift.

Running RHODS on OpenShift gives the freedom to build and deploy models on-premises or on any cloud. The open source version of RHODS is Open Data Hub (https://opendatahub.io). RHODS provides a subset of the components available in Open Data Hub but in a commercially supported way. The RHODS platform integrates well with technology partners to form a complete MLOps stack.

You will learn about the RHODS platform throughout this book. Let’s start by defining some of its building blocks:

  • Model development and tuning: RHODS provides out-of-the-box support for JupyterHub, a powerful and popular multi-user Jupyter...

The advantages of the cloud

Cloud computing provides on-demand delivery of IT resources such as servers, networks, storage, databases, and all higher-level application services via the internet with a pay-as-you-go pricing model. The prominent vendors for the cloud are Amazon Web Services (AWS), Microsoft Azure, and Google Cloud, and they all provide usage-based pricing.

The cloud has many benefits, but the top three are agility, innovation, and cost savings. Let’s take a brief look at all three.

Agility ensures that the teams can experiment with new ideas quickly and frequently. That’s because the speed your team can deliver software is higher when the team doesn’t wait for IT to provision infrastructure. This makes the foundation of autonomous product teams, where they can release products, collect feedback, and improve the software to meet your customers’ needs.

Agility powers your team to focus on business competence instead of using the time...

ROSA

ROSA is a fully managed turnkey application platform that enables you to focus on delivering value to your customers. ROSA is a service operated by Red Hat and jointly supported with AWS to provide a fully managed OpenShift platform. Red Hat and AWS teams work on the underlying infrastructure for you to reduce the burden of managing infrastructure. ROSA also includes integration with a wide range of AWS services, such as databases and mobile, to help you further accelerate building solutions for your organization.

The following are some of the benefits of the ROSA platform:

  • If you are running OpenShift on-premises, ROSA provides the fastest path to running OpenShift in the cloud. ROSA provides production-ready OpenShift as a service on the AWS platform.
  • Red Hat and AWS jointly operate and support ROSA. This provides an integrated support channel for you with a 99.95% uptime. (The 99.95% uptime is quoted from the vendor's site and may change).
  • ROSA provides...

Summary

In this chapter, you learned about the problems MLOps aims to tackle and how it can increase the velocity of your data science initiatives. You also refreshed your knowledge of Kubernetes and OpenShift and saw how Red Hat OpenShift provides a consistent and reliable environment where you can run your container workloads on-premises and in the cloud. You have seen how RHODS, using the strengths of the underlying container platform, provides a full set of components for an MLOps platform.

In the next chapter, you will learn about the stages of the ML life cycle, as well as the role MLOps plays in implementing all the stages of model development and deployment. You will also see how teams collaborate during model development and deployment stages and how RHODS components relate to each stage of the ML life cycle.

References

To learn more about the topics that were covered in this chapter, take a look at the following resources:

Left arrow icon Right arrow icon
Download code icon Download Code

Key benefits

  • Grasp MLOps and machine learning project lifecycle through concept introductions
  • Get hands on with provisioning and configuring Red Hat OpenShift Data Science
  • Explore model training, deployment, and MLOps pipeline building with step-by-step instructions
  • Purchase of the print or Kindle book includes a free PDF eBook

Description

MLOps with OpenShift offers practical insights for implementing MLOps workflows on the dynamic OpenShift platform. As organizations worldwide seek to harness the power of machine learning operations, this book lays the foundation for your MLOps success. Starting with an exploration of key MLOps concepts, including data preparation, model training, and deployment, you’ll prepare to unleash OpenShift capabilities, kicking off with a primer on containers, pods, operators, and more. With the groundwork in place, you’ll be guided to MLOps workflows, uncovering the applications of popular machine learning frameworks for training and testing models on the platform. As you advance through the chapters, you’ll focus on the open-source data science and machine learning platform, Red Hat OpenShift Data Science, and its partner components, such as Pachyderm and Intel OpenVino, to understand their role in building and managing data pipelines, as well as deploying and monitoring machine learning models. Armed with this comprehensive knowledge, you’ll be able to implement MLOps workflows on the OpenShift platform proficiently.

Who is this book for?

This book is for MLOps and DevOps engineers, data architects, and data scientists interested in learning the OpenShift platform. Particularly, developers who want to learn MLOps and its components will find this book useful. Whether you’re a machine learning engineer or software developer, this book serves as an essential guide to building scalable and efficient machine learning workflows on the OpenShift platform.

What you will learn

  • Build a solid foundation in key MLOps concepts and best practices
  • Explore MLOps workflows, covering model development and training
  • Implement complete MLOps workflows on the Red Hat OpenShift platform
  • Build MLOps pipelines for automating model training and deployments
  • Discover model serving approaches using Seldon and Intel OpenVino
  • Get to grips with operating data science and machine learning workloads in OpenShift
Estimated delivery fee Deliver to Portugal

Premium delivery 7 - 10 business days

€17.95
(Includes tracking information)

Product Details

Country selected
Publication date, Length, Edition, Language, ISBN-13
Publication date : Jan 31, 2024
Length: 238 pages
Edition : 1st
Language : English
ISBN-13 : 9781805120230
Category :
Tools :

What do you get with Print?

Product feature icon Instant access to your digital eBook copy whilst your Print order is Shipped
Product feature icon Paperback book shipped to your preferred address
Product feature icon Download this book in EPUB and PDF formats
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want
Product feature icon AI Assistant (beta) to help accelerate your learning
OR
Modal Close icon
Payment Processing...
tick Completed

Shipping Address

Billing Address

Shipping Methods
Estimated delivery fee Deliver to Portugal

Premium delivery 7 - 10 business days

€17.95
(Includes tracking information)

Product Details

Publication date : Jan 31, 2024
Length: 238 pages
Edition : 1st
Language : English
ISBN-13 : 9781805120230
Category :
Tools :

Packt Subscriptions

See our plans and pricing
Modal Close icon
€18.99 billed monthly
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Simple pricing, no contract
€189.99 billed annually
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just €5 each
Feature tick icon Exclusive print discounts
€264.99 billed in 18 months
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just €5 each
Feature tick icon Exclusive print discounts

Frequently bought together


Stars icon
Total 109.97
MLOps with Red Hat OpenShift
€33.99
Azure Data Engineer Associate Certification Guide
€37.99
Bayesian Analysis with Python
€37.99
Total 109.97 Stars icon
Banner background image

Table of Contents

12 Chapters
Part 1: Introduction Chevron down icon Chevron up icon
Chapter 1: Introduction to MLOps and OpenShift Chevron down icon Chevron up icon
Part 2: Provisioning and Configuration Chevron down icon Chevron up icon
Chapter 2: Provisioning an MLOps Platform in the Cloud Chevron down icon Chevron up icon
Chapter 3: Building Machine Learning Models with OpenShift Chevron down icon Chevron up icon
Part 3: Operating ML Workloads Chevron down icon Chevron up icon
Chapter 4: Managing a Model Training Workflow Chevron down icon Chevron up icon
Chapter 5: Deploying ML Models as a Service Chevron down icon Chevron up icon
Chapter 6: Operating ML Workloads Chevron down icon Chevron up icon
Chapter 7: Building a Face Detector Using the Red Hat ML Platform Chevron down icon Chevron up icon
Index Chevron down icon Chevron up icon
Other Books You May Enjoy Chevron down icon Chevron up icon

Customer reviews

Rating distribution
Full star icon Full star icon Full star icon Full star icon Full star icon 5
(2 Ratings)
5 star 100%
4 star 0%
3 star 0%
2 star 0%
1 star 0%
H2N Mar 11, 2024
Full star icon Full star icon Full star icon Full star icon Full star icon 5
It is for MLOps engineers, DevOps engineers, IT architects, and data scientists interested in MLOps and the Red Hat OpenShift Data Science platform. It introduces MLOps concepts and the Red Hat OpenShift platform, walking readers through provisioning an MLOps platform in the cloud, building machine learning models with OpenShift, managing model training workflows, deploying ML models as a service, and operating ML workloads.
Amazon Verified review Amazon
Om S Mar 08, 2024
Full star icon Full star icon Full star icon Full star icon Full star icon 5
"MLOps with Red Hat OpenShift" serves as an essential tool for MLOps and DevOps engineers, data experts, and scientists keen on mastering machine learning operations (MLOps) using OpenShift. This book breaks down MLOps into digestible parts, from initial data setup to the final deployment of models, guiding readers through using OpenShift to create effective ML pipelines. It begins with fundamental MLOps concepts, preparing readers with a solid foundation and a clear understanding of OpenShift's basics, such as containers and pods.The journey continues as readers dive into MLOps workflows, exploring the integration of machine learning frameworks for model training and testing. The focus then shifts to the use of Red Hat OpenShift Data Science and partner components like Pachyderm and Intel OpenVino. These tools play critical roles in managing data pipelines and deploying and monitoring machine learning models.Step-by-step instructions ensure that readers can follow along with ease, making the complexities of MLOps workflows manageable and understandable. The book not only educates on building MLOps pipelines for automation but also delves into model serving techniques using advanced tools like Seldon and Intel OpenVino.Targeted at MLOps and DevOps engineers, data architects, and scientists interested in leveraging OpenShift for machine learning, this book is also an invaluable resource for developers eager to learn about MLOps components. It effectively demystifies the process of building scalable and efficient machine learning workflows on the OpenShift platform, offering readers the skills needed for MLOps success.
Amazon Verified review Amazon
Get free access to Packt library with over 7500+ books and video courses for 7 days!
Start Free Trial

FAQs

What is the delivery time and cost of print book? Chevron down icon Chevron up icon

Shipping Details

USA:

'

Economy: Delivery to most addresses in the US within 10-15 business days

Premium: Trackable Delivery to most addresses in the US within 3-8 business days

UK:

Economy: Delivery to most addresses in the U.K. within 7-9 business days.
Shipments are not trackable

Premium: Trackable delivery to most addresses in the U.K. within 3-4 business days!
Add one extra business day for deliveries to Northern Ireland and Scottish Highlands and islands

EU:

Premium: Trackable delivery to most EU destinations within 4-9 business days.

Australia:

Economy: Can deliver to P. O. Boxes and private residences.
Trackable service with delivery to addresses in Australia only.
Delivery time ranges from 7-9 business days for VIC and 8-10 business days for Interstate metro
Delivery time is up to 15 business days for remote areas of WA, NT & QLD.

Premium: Delivery to addresses in Australia only
Trackable delivery to most P. O. Boxes and private residences in Australia within 4-5 days based on the distance to a destination following dispatch.

India:

Premium: Delivery to most Indian addresses within 5-6 business days

Rest of the World:

Premium: Countries in the American continent: Trackable delivery to most countries within 4-7 business days

Asia:

Premium: Delivery to most Asian addresses within 5-9 business days

Disclaimer:
All orders received before 5 PM U.K time would start printing from the next business day. So the estimated delivery times start from the next day as well. Orders received after 5 PM U.K time (in our internal systems) on a business day or anytime on the weekend will begin printing the second to next business day. For example, an order placed at 11 AM today will begin printing tomorrow, whereas an order placed at 9 PM tonight will begin printing the day after tomorrow.


Unfortunately, due to several restrictions, we are unable to ship to the following countries:

  1. Afghanistan
  2. American Samoa
  3. Belarus
  4. Brunei Darussalam
  5. Central African Republic
  6. The Democratic Republic of Congo
  7. Eritrea
  8. Guinea-bissau
  9. Iran
  10. Lebanon
  11. Libiya Arab Jamahriya
  12. Somalia
  13. Sudan
  14. Russian Federation
  15. Syrian Arab Republic
  16. Ukraine
  17. Venezuela
What is custom duty/charge? Chevron down icon Chevron up icon

Customs duty are charges levied on goods when they cross international borders. It is a tax that is imposed on imported goods. These duties are charged by special authorities and bodies created by local governments and are meant to protect local industries, economies, and businesses.

Do I have to pay customs charges for the print book order? Chevron down icon Chevron up icon

The orders shipped to the countries that are listed under EU27 will not bear custom charges. They are paid by Packt as part of the order.

List of EU27 countries: www.gov.uk/eu-eea:

A custom duty or localized taxes may be applicable on the shipment and would be charged by the recipient country outside of the EU27 which should be paid by the customer and these duties are not included in the shipping charges been charged on the order.

How do I know my custom duty charges? Chevron down icon Chevron up icon

The amount of duty payable varies greatly depending on the imported goods, the country of origin and several other factors like the total invoice amount or dimensions like weight, and other such criteria applicable in your country.

For example:

  • If you live in Mexico, and the declared value of your ordered items is over $ 50, for you to receive a package, you will have to pay additional import tax of 19% which will be $ 9.50 to the courier service.
  • Whereas if you live in Turkey, and the declared value of your ordered items is over € 22, for you to receive a package, you will have to pay additional import tax of 18% which will be € 3.96 to the courier service.
How can I cancel my order? Chevron down icon Chevron up icon

Cancellation Policy for Published Printed Books:

You can cancel any order within 1 hour of placing the order. Simply contact customercare@packt.com with your order details or payment transaction id. If your order has already started the shipment process, we will do our best to stop it. However, if it is already on the way to you then when you receive it, you can contact us at customercare@packt.com using the returns and refund process.

Please understand that Packt Publishing cannot provide refunds or cancel any order except for the cases described in our Return Policy (i.e. Packt Publishing agrees to replace your printed book because it arrives damaged or material defect in book), Packt Publishing will not accept returns.

What is your returns and refunds policy? Chevron down icon Chevron up icon

Return Policy:

We want you to be happy with your purchase from Packtpub.com. We will not hassle you with returning print books to us. If the print book you receive from us is incorrect, damaged, doesn't work or is unacceptably late, please contact Customer Relations Team on customercare@packt.com with the order number and issue details as explained below:

  1. If you ordered (eBook, Video or Print Book) incorrectly or accidentally, please contact Customer Relations Team on customercare@packt.com within one hour of placing the order and we will replace/refund you the item cost.
  2. Sadly, if your eBook or Video file is faulty or a fault occurs during the eBook or Video being made available to you, i.e. during download then you should contact Customer Relations Team within 14 days of purchase on customercare@packt.com who will be able to resolve this issue for you.
  3. You will have a choice of replacement or refund of the problem items.(damaged, defective or incorrect)
  4. Once Customer Care Team confirms that you will be refunded, you should receive the refund within 10 to 12 working days.
  5. If you are only requesting a refund of one book from a multiple order, then we will refund you the appropriate single item.
  6. Where the items were shipped under a free shipping offer, there will be no shipping costs to refund.

On the off chance your printed book arrives damaged, with book material defect, contact our Customer Relation Team on customercare@packt.com within 14 days of receipt of the book with appropriate evidence of damage and we will work with you to secure a replacement copy, if necessary. Please note that each printed book you order from us is individually made by Packt's professional book-printing partner which is on a print-on-demand basis.

What tax is charged? Chevron down icon Chevron up icon

Currently, no tax is charged on the purchase of any print book (subject to change based on the laws and regulations). A localized VAT fee is charged only to our European and UK customers on eBooks, Video and subscriptions that they buy. GST is charged to Indian customers for eBooks and video purchases.

What payment methods can I use? Chevron down icon Chevron up icon

You can pay with the following card types:

  1. Visa Debit
  2. Visa Credit
  3. MasterCard
  4. PayPal
What is the delivery time and cost of print books? Chevron down icon Chevron up icon

Shipping Details

USA:

'

Economy: Delivery to most addresses in the US within 10-15 business days

Premium: Trackable Delivery to most addresses in the US within 3-8 business days

UK:

Economy: Delivery to most addresses in the U.K. within 7-9 business days.
Shipments are not trackable

Premium: Trackable delivery to most addresses in the U.K. within 3-4 business days!
Add one extra business day for deliveries to Northern Ireland and Scottish Highlands and islands

EU:

Premium: Trackable delivery to most EU destinations within 4-9 business days.

Australia:

Economy: Can deliver to P. O. Boxes and private residences.
Trackable service with delivery to addresses in Australia only.
Delivery time ranges from 7-9 business days for VIC and 8-10 business days for Interstate metro
Delivery time is up to 15 business days for remote areas of WA, NT & QLD.

Premium: Delivery to addresses in Australia only
Trackable delivery to most P. O. Boxes and private residences in Australia within 4-5 days based on the distance to a destination following dispatch.

India:

Premium: Delivery to most Indian addresses within 5-6 business days

Rest of the World:

Premium: Countries in the American continent: Trackable delivery to most countries within 4-7 business days

Asia:

Premium: Delivery to most Asian addresses within 5-9 business days

Disclaimer:
All orders received before 5 PM U.K time would start printing from the next business day. So the estimated delivery times start from the next day as well. Orders received after 5 PM U.K time (in our internal systems) on a business day or anytime on the weekend will begin printing the second to next business day. For example, an order placed at 11 AM today will begin printing tomorrow, whereas an order placed at 9 PM tonight will begin printing the day after tomorrow.


Unfortunately, due to several restrictions, we are unable to ship to the following countries:

  1. Afghanistan
  2. American Samoa
  3. Belarus
  4. Brunei Darussalam
  5. Central African Republic
  6. The Democratic Republic of Congo
  7. Eritrea
  8. Guinea-bissau
  9. Iran
  10. Lebanon
  11. Libiya Arab Jamahriya
  12. Somalia
  13. Sudan
  14. Russian Federation
  15. Syrian Arab Republic
  16. Ukraine
  17. Venezuela