Entry 51: Ensemble Learning
Ensemble techniques began to appear in the 1990s according to page 192 of Applied Predictive Modeling. Most people think of Random Forests (basically a bunch...
Recent Posts
Entry 50: Decision Tree Subtypes
The Complete Guide to Decision Trees sums up the similarities between Decision Tree Algorithms very succinctly:
Entry 49: Decision Trees Analysis and Interpretation
One of the major benefits of using Decision Trees is their interpretability. To take advantage of this benefit, you need to know how to pull out the informat...
Entry 48: Decision Tree Impurity Measures
Impurity seems like it should be a simple calculation. However, depending on prevalence of classes and quirks in the data, it’s usually not as straight forwa...
Entry 47: Pruning Decision Trees
If allowed to continue, a Decision Tree will continue to split the data until each leaf is pure. This causes two problems: