You're reading from Learn TensorFlow Enterprise Build, manage, and scale machine learning workloads seamlessly using Google's TensorFlow Enterprise

Product type Paperback

Published in Nov 2020

Publisher Packt

ISBN-13 9781800209145

Length 314 pages

Edition 1st Edition

Languages

Python

Tools

TensorFlow

Concepts

Artificial Intelligence

Author (1):

KC Tung

View More author details

Table of Contents (15) Chapters

Preface

1. Section 1 – TensorFlow Enterprise Services and Features

2. Chapter 1: Overview of TensorFlow Enterprise FREE CHAPTER

3. Chapter 2: Running TensorFlow Enterprise in Google AI Platform

4. Section 2 – Data Preprocessing and Modeling

5. Chapter 3: Data Preparation and Manipulation Techniques

6. Chapter 4: Reusable Models and Scalable Data Pipelines

7. Section 3 – Scaling and Tuning ML Works

8. Chapter 5: Training at Scale

9. Chapter 6: Hyperparameter Tuning

10. Section 4 – Model Optimization and Deployment

11. Chapter 7: Model Optimization

12. Chapter 8: Best Practices for Model Training and Performance

13. Chapter 9: Serving a TensorFlow Model

14. Other Books You May Enjoy

Leave a review - let other readers know what you think

Understanding TensorFlow Serving with Docker

At the core of TFS is actually a TensorFlow model server that runs a model Protobuf file. Installing the model server is not straightforward, as there are many dependencies. As a convenience, the TensorFlow team also provides this model server in a Docker container, which is a platform that uses virtualization at the operating system level, and it is self-contained with all the necessary dependencies (that is, libraries or modules) to run in an isolated environment.

Therefore, the easiest way to deploy a TensorFlow SavedModel is by means of TFS with a Docker container. To install Docker, you can refer to the Docker site (https://docs.docker.com/install/), along with the instructions for Mac, Windows, or Linux installations. For our chapter, a community version will suffice. We will be using Docker Desktop 2.4 running in macOS Catalina 10.15.6 with specs as indicated in Figure 9.1:

Figure 9.1 – The Docker...