• Soledad Galli

Boosting Algorithms

Updated: Nov 11, 2019

Recommended Online Resources to Learn About Bagging and Boosting Algorithms

Recommended Scientific Articles to Learn About Bagging and Boosting


Overview of the Recommended Resources

Stepping Into​

For those giving the first steps into bagging algorithms and boosting trees, the LinkedIn post Machine Data Science Accessible: Tree methods, gives a good intuition on how these models work, without the stress of mathematical formulations. Following that, the Random Forests website by Leo Breiman and Adele Cutler provides a clear explanation of Random Forests, plus a variety of resources for further study. Finally, you can learn about bagging and boosting algorithms in Trevor Hastie’s Gradient Boosting Machine talk on YouTube. The book Introduction of Statistical Learning, also provides a good introduction into bagging and boosting of algorithms, without relying heavily on maths, and providing examples in R.


To get a better understanding on the mathematical reasoning underlying these algorithms, the book Elements of Statistical Learning provides a good starting point, covering bagging and boosting extensively, and offering explanatory examples.

To dig even deeper in understanding these algorithms, the scientific articles from the creators of the models, and more recent revisions which summarise the different algorithms, highlight the advantages and limitations of the different models.

In scientific articles, the authors describe the algorithms, i.e., Bagging, Boosting or Random Forests, and discuss in detail their advantages over existing models. They provide a variety of examples on real or simulated data where these methods have been successfully implemented. Scientific articles are usually very rich in the mathematical formulations that explain the functionality of the model. They are good for those seeking to understand the mathematical pillars of the algorithms and how they were developed.

Disclaimer: Opinions are my own and I do not become financial compensation from any of the links included in this article.


Get the latest tutorials, releases and demos!

Privacy statement: By providing us with your email address, you are giving us permission to contact you with news related to our courses, books, open-source packages, and related notifications.

We will not share your information with third-parties. You can unsubscribe anytime. For more info, read our full Privacy Policy.

© 2018 - 2020 Train In Data

  • YouTube - Grey Circle
  • Soledad Galli - Twitter
  • LinkedIn - Grey Circle