Preparing the data
The example scenario we will use for the cookbook is on-time flight performance data (that is, flights scenario) that will make use of two sets of data:
- Airline On-Time Performance and Causes of Flight Delays, available at http://bit.ly/2ccJPPM. These datasets contain information about scheduled and actual departure and arrival times of flights, and the delay causes. The data is represented as reported by US air carriers and is collected by the Office of Airline Information, Bureau of Transportation Statistics (BTS).
- OpenFlights, airport and airline data available at http://openflights.org/data.html. This dataset contains the list of US airport data, including the IATA code, airport name, and airport location.
We will create two DataFrames: one for the airports and one for the flights. The airports DataFrame will make up our vertices and the flights DataFrames will represent all the edges of our GraphFrame.
Getting ready
If you are running this locally, please copy the linked...
