Chapter 5. The Bare Bones Boosting Algorithms
What do we mean by bare bones boosting algorithms? The boosting algorithm (and its variants) is arguably one of the most important algorithms in the machine learning toolbox. Any data analyst needs to know this algorithm, and eventually the push for higher accuracy invariably drives towards the need for the boosting technique. It has been reported on the www.kaggle.org forums that boosting algorithms for complex and voluminous data run for several weeks and that most award-winning solutions are based on this. Furthermore, the algorithms run on modern graphical device machines.
Taking its importance into account, we will study the boosting algorithm in detail here. Bare bones is certainly not a variant of the boosting algorithm. Since the boosting algorithm is one of the very important and vital algorithms, we will first state the algorithm and implement it in a rudimentary fashion, which will show each step of the algorithm in action...
