Installing GraphX and GraphFrames

Spark has some distributed libraries that are not available anywhere else in data science. GraphFrames is one of them. In graph theory, you can perform actions such as finding the shortest path, network flow, homophily, centrality, and influence. Because GraphFrames is built on GraphX, which is a Java library, you need to install the Java library, and then to use the Python wrapper, you will need to pip install the Python library that accesses the Java JAR file. The installation steps are as follows:

1. Download a JAR file from https://spark-packages.org/package/graphframes/graphframes. You'll need to find a version that matches the version of Spark that you are running in your cluster.
2. In the Workspace tab of Databricks, right-click anywhere and from the dropdown, click on Create and then Library.
3. Drag and drop the JAR file into the space titled Drop JAR here.
4. Click Create.
5. Then, import another library.
6. In the Workspace tab of Databricks...