Monitoring your Synapse Spark pools
When you're developing your Spark application, you will sometimes need to get your hands deep into the engine to dig into the details of your jobs and the environment you run them in.
To ascertain details regarding your environment, navigate to the Synapse management hub. Your first stop is the Apache Spark pools section. You will see a list of all Spark pools, and by clicking on them, you can get an overview page with information about occupied vCores, allocated memory, and active Spark applications:
The next level of detail to investigate will then be the application itself. You will find the Applications overview in the Management pane in Synapse Studio. You will be taken to a list of all applications that are present in your Synapse environment. By clicking on the application name on the line you're interested in, you'll get to the application details...