Performing distributed inference

In this chapter, we have discussed how to perform distributed training using DL4J. We have also performed distributed evaluation to evaluate the trained distributed model. Now, let's discuss how to utilize the distributed model to solve use cases such as predictions. This is referred to as inference. Let's go over how we can perform distributed inference in a Spark environment.

In this recipe, we will perform distributed inference on Spark using DL4J.

How to do it...

1. Perform distributed inference for SparkDl4jMultiLayer by calling feedForwardWithKey(), as shown here:

SparkDl4jMultiLayer.feedForwardWithKey(JavaPairRDD<K, INDArray> featuresData, int batchSize);

2. Perform...