Deployment and monitoring
In this section, we will discuss the various methodologies for deploying and monitoring Spark Streaming applications. Deployment and monitoring is a vast topic and it becomes complex when we talk about distributed deployments and monitoring. Discussing all aspects of Spark deployment is out of the scope of this book, but we will touch upon the various aspects of deployments and monitoring which will help us to understand the various features and flexibility provided by Spark and Spark Streaming.
Cluster managers for Spark Streaming
Spark is a framework that does not enforce any app servers or deployment stack. Spark provides the integration and deployment of Spark and Spark-based applications on various distributed cluster managers such as Standalone, Yarn, or Mesos. We saw the deployments on Standalone in the Configuring the Spark cluster section in Chapter 6, Getting Acquainted with Spark. Let's move forward and deploy our streaming application on Yarn and...
