This section will examine Apache Spark GraphX programming in Scala using the family relationship graph data sample shown in the last section. This data will be accessed as a list of vertices and edges. Although this data set is small, the graphs that you build in this way could be very large. For example we've been able to analyze 30 TB of financial transaction data of a large bank using only four Apache Spark workers.
Graph analytics/processing with GraphX
The raw data
We are working with two data files. They contain the data that will be used for this section in terms of the vertices and edges that make up a graph:
graph1_edges.csv
graph1_vertex.csv
The vertex file contains just six lines representing the graph used in the...