Histogram-based Algorithm | Train in Data

This site uses cookies

Cookies are important for this site to function properly, to guarantee your safety, and to provide you with the best experience. By continuing to browse, you agree to the use of these cookies.
Learn More.

Autoplay
Autocomplete

Previous Lesson Complete and Continue

Master Tree Ensemble Models: From Decision Trees to Gradient Boosting

Introduction

Welcome and Course Overview (3:21)
Course Curriculum (2:56)
Course Materials
How did you hear about us?

Foundations of Decision Trees

Understanding Decision Trees (5:20)
Quiz: How Do Decision Trees Make Predictions?
Decision tree induction (11:03)
Stopping criteria (11:22)
Prunning (8:50)
Training a classification tree (17:23)
Training a regression tree (9:56)
Wrapping up (2:56)
Quiz
Additional reading resources
Refer a friend

Bagging and Random Forests

Introduction to ensemble learning (3:39)
Bagging (9:58)
Random forests (13:22)
Training random forests for classification (9:05)
Training random forests for regression (6:09)
Wrapping up (4:39)
Quiz
Additional reading resources

Boosting Trees

Boosting trees (7:10)
AdaBoost (21:00)
Training Adaboost for classification (6:14)
AdaBoost and the exponential loss (6:01)
AdaBoost for regression (13:35)
Training AdaBoost for regression (10:35)
Gradient boosting (22:06)
Loss functions for regression (12:22)
Training a GBM for regression (19:37)
Gradient boosting for classification (17:35)
Training a GBM for classification (8:30)
Predicting percentiles in regression (12:45)
Predicting intervals with the quantile loss (3:02)
Wrapping up
Quiz
Additional reading resources

XGBoost

Introduction to XGBoost (8:39)
Regularized Objective Function (20:03)
Split Gain (10:01)
Split Finding Algorithm (7:46)
Weighted Quantile Sketch (8:22)
Sparsity-aware Split Finding (7:16)
Feature Importance (8:23)
Hyperparameters of XGBoost - Part 1 (12:43)
Hyperparameters of XGBoost - Part 2 (11:09)
Additional reading resources

LightGBM

Introduction to LightGBM (5:13)
Histogram-based Algorithm (9:02)
Gradient-based One-Side Sampling (GOSS) (10:23)
Exclusive Feature Bundling (EFB) (9:54)
Leaf-wise Tree Growth (7:16)
Hyperparameters of LightGBM - Part 1 (8:03)
Hyperparameters of LightGBM - Part 2 (10:13)
Additional reading resources

CatBoost

Introduciton to CatBoost (7:19)
Target Statistics & Conditional Shift (17:32)
Ordered Target Statistics (11:47)
Oblivious Tree (9:09)
Prediction Shift (6:36)
Additional reading resources

Histogram-based Algorithm

Lesson content locked

If you're already enrolled, you'll need to login.

Enroll in Course to Unlock