Assessing the Predict Damage binary prediction ML model
The Predict Damage ML model that you built and reviewed in the previous two chapters is designed to predict the likelihood that damage was reported due to wildlife striking an aircraft. A few key metrics from the training report for that binary prediction model can be seen in the following table:
|
Metric name |
Metric value |
Comments |
|
Area Under the Curve (AUC) |
91% |
The AUC indicates the performance of an ML model, with 100% being perfect. 50% would be random guessing, while less than 50% indicates predictions worse than random guessing. |
|
Row Count for Training |
23,356 |
The number of rows used to train the ML model. |
|
Row Count for Testing |
... |
