Classification Trees

Binary decision trees for multiclass learning

To interactively grow a classification tree, use the Classification Learner app. For greater flexibility, grow a classification tree using fitctree at the command line. After growing a classification tree, predict labels by passing the tree and new predictor data to predict.

Apps

Classification Learner

Train models to classify data using supervised machine learning

Blocks

ClassificationTree Predict

Classify observations using decision tree classifier (Since R2021a)

Functions

expand all

Create Classification Tree

`fitctree`	Fit binary decision tree for multiclass classification
`compact`	Reduce size of classification tree model
`prune`	Produce sequence of classification subtrees by pruning classification tree

Improve Classification Tree

cvloss Classification error by cross-validation for classification tree model

Interpret Classification Tree

`lime`	Local interpretable model-agnostic explanations (LIME) (Since R2020b)
`nodeVariableRange`	Retrieve variable range of decision tree node (Since R2020a)
`partialDependence`	Compute partial dependence (Since R2020b)
`permutationImportance`	Predictor importance by permutation (Since R2024a)
`plotPartialDependence`	Create partial dependence plot (PDP) and individual conditional expectation (ICE) plots
`predictorImportance`	Estimates of predictor importance for classification tree
`shapley`	Shapley values (Since R2021a)
`surrogateAssociation`	Mean predictive measure of association for surrogate splits in classification tree
`view`	View classification tree

Cross-Validate Classification Tree

`crossval`	Cross-validate machine learning model
`kfoldEdge`	Classification edge for cross-validated classification model
`kfoldLoss`	Classification loss for cross-validated classification model
`kfoldMargin`	Classification margins for cross-validated classification model
`kfoldPredict`	Classify observations in cross-validated classification model
`kfoldfun`	Cross-validate function for classification

Measure Performance

`loss`	Classification loss for classification tree model
`resubLoss`	Resubstitution classification loss for classification tree model
`compareHoldout`	Compare accuracies of two classification models using new data
`edge`	Classification edge for classification tree model
`margin`	Classification margins for classification tree model
`resubEdge`	Resubstitution classification edge for classification tree model
`resubMargin`	Resubstitution classification margins for classification tree model
`testckfold`	Compare accuracies of two classification models by repeated cross-validation

Classify Observations

`predict`	Predict labels using classification tree model
`resubPredict`	Classify observations in classification tree by resubstitution

Gather Properties of Classification Tree

gather Gather properties of Statistics and Machine Learning Toolbox object from GPU (Since R2020b)

Objects

`ClassificationTree`	Binary decision tree for multiclass classification
`CompactClassificationTree`	Compact classification tree
`ClassificationPartitionedModel`	Cross-validated classification model

Topics

Train Decision Trees Using Classification Learner App
Create and compare classification trees, and export trained models to make predictions for new data.
Supervised Learning Workflow and Algorithms
Understand the steps for supervised learning and the characteristics of nonparametric classification and regression functions.
Decision Trees
Understand decision trees and how to fit them to data.
Growing Decision Trees
To grow decision trees, fitctree and fitrtree apply the standard CART algorithm by default to the training data.
View Decision Tree
Create and view a text or graphic description of a trained decision tree.
Visualize Decision Surfaces of Different Classifiers
This example shows how to visualize the decision surface for different classification algorithms.
Splitting Categorical Predictors in Classification Trees
Learn about the heuristic algorithms for optimally splitting categorical variables with many levels while growing decision trees.
Improving Classification Trees and Regression Trees
Tune trees by setting name-value pair arguments in fitctree and fitrtree.
Prediction Using Classification and Regression Trees
Predict class labels or responses using trained classification and regression trees.
Predict Out-of-Sample Responses of Subtrees
Predict responses for new data using a trained regression tree, and then plot the results.
Predict Class Labels Using ClassificationTree Predict Block
Train a classification decision tree model using the Classification Learner app, and then use the ClassificationTree Predict block for label prediction.
Human Activity Recognition Simulink Model for Fixed-Point Deployment
Generate code from a classification Simulink^® model prepared for fixed-point deployment.
Identify Punch and Flex Hand Gestures Using Machine Learning Algorithm on Arduino Hardware (Simulink)
This example shows how to use the Simulink® Support Package for Arduino® Hardware to identify punch and flex hand gestures using a machine learning algorithm.