For regression algorithms, the winner is
Let's look at the performance of the three regression algorithms that we used on the same data and exactly the same use case:
Algorithm | RMSE |
Linear regression | 4.36214129677179 |
Regression tree | 5.2771702288377 |
Gradient boost regression | 4.034836373089085 |
Looking at the performance of all the regression algorithms, it is obvious that the performance of gradient boost regression is the best as it has the lowest RMSE. This is followed by linear regression. The regression tree algorithm performed the worst for this problem.