Graph analytics/processing with GraphX
This section will examine Apache Spark GraphX programming in Scala using the family relationship graph data sample shown in the last section. This data will be accessed as a list of vertices and edges. Although this data set is small, the graphs that you build in this way could be very large. For example, we've been able to analyze 30 TB of financial transaction data of a large bank using only four Apache Spark workers.
The raw data
We are working with two data files. They contain the data that will be used for this section in terms of the vertices and edges that make up a graph:
graph1_edges.csv graph1_vertex.csv
The vertex
file contains just six lines representing the graph used in the last section. Each vertex
represents a person and has a vertex ID number, a name, and an age value:
1,Mike,48 2,Sarah,45 3,John,25 4,Jim,53 5,Kate,22 6,Flo,52
The edge
file contains a set of directed edge
values in the form source vertex ID, destination vertex ID, and relationship...