TensorFlow Serving on Kubernetes
According to https://kubernets.io:
Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications.
TensorFlow models can be scaled to be served from hundreds or thousands of TF Serving
services using Kubernetes clusters in the production environment. Kubernetes clusters can be run on all popular public clouds, such as GCP, AWS, Azure, as well as in your on-premises private cloud. So let us dive right in to learn to install Kubernetes and then deploy the MNIST model on Kubernetes Cluster.
Installing Kubernetes
We installed Kubernetes on Ubuntu 16.04 in a single-node local cluster mode as per the following steps:
- Install LXD and Docker, which are prerequisites to install Kubernetes locally. LXD is the container manager that works with linux containers. We already learned how to install Docker in the previous section. To install LXD, run the following command:
$ sudo snap install lxd
lxd 2.19 from 'canonical'installed...