回归树集成

随机森林、提升回归树和装袋回归树

回归树集成是由多个回归树的加权组合构成的预测模型。通常，组合多个回归树可以提高预测性能。要使用 LSBoost 提升回归树，可以使用 fitrensemble。要使用装袋法组合回归树或要生成随机森林，可以使用 fitrensemble 或 TreeBagger。要使用装袋回归树实现分位数回归，可以使用 TreeBagger。

对于分类集成，例如提升分类树或装袋分类树、随机子空间集成或用于多分类的纠错输出编码 (ECOC) 模型，请参阅分类集成。

App

回归学习器

使用有监督机器学习训练回归模型来预测数据

模块

RegressionEnsemble Predict

Predict responses using ensemble of decision trees for regression (自 R2021a 起)

函数

全部展开

回归集成

创建回归集成

`fitrensemble`	Fit ensemble of learners for regression
`compact`	Reduce size of regression ensemble model
`fitensemble`	Fit ensemble of learners for classification and regression

修改回归集成

`regularize`	Find optimal weights for learners in regression ensemble
`removeLearners`	Remove members of compact regression ensemble
`resume`	Resume training of regression ensemble model
`shrink`	Prune regression ensemble

交叉验证回归集成

`cvshrink`	Cross-validate pruning and regularization of regression ensemble
`kfoldLoss`	Loss for cross-validated partitioned regression model
`kfoldPredict`	Predict responses for observations in cross-validated regression model
`kfoldfun`	Cross-validate function for regression

测量性能

`loss`	Regression error for regression ensemble model
`resubLoss`	Resubstitution loss for regression ensemble model

为观测值分类

`predict`	Predict responses using regression ensemble model
`resubPredict`	Predict response of regression ensemble by resubstitution

收集回归集成的属性

gather Gather properties of Statistics and Machine Learning Toolbox object from GPU (自 R2020b 起)

装袋回归树

`fitrensemble`	Fit ensemble of learners for regression
`TreeBagger`	Ensemble of bagged decision trees
`predict`	Predict responses using ensemble of bagged decision trees
`oobPredict`	Ensemble predictions for out-of-bag observations
`quantilePredict`	Predict response quantile using bag of regression trees
`oobQuantilePredict`	Quantile predictions for out-of-bag observations from bag of regression trees

改进回归

crossval Cross-validate machine learning model

解释回归

`lime`	Local interpretable model-agnostic explanations (LIME) (自 R2020b 起)
`partialDependence`	Compute partial dependence (自 R2020b 起)
`permutationImportance`	Predictor importance by permutation (自 R2024a 起)
`plotPartialDependence`	Create partial dependence plot (PDP) and individual conditional expectation (ICE) plots
`predictorImportance`	Estimates of predictor importance for regression ensemble of decision trees
`shapley`	Shapley values (自 R2021a 起)

对象

全部展开

回归树集成

`RegressionEnsemble`	Ensemble regression
`CompactRegressionEnsemble`	Compact regression ensemble
`RegressionPartitionedEnsemble`	Cross-validated regression ensemble

装袋回归树

`TreeBagger`	Ensemble of bagged decision trees
`CompactTreeBagger`	Compact ensemble of bagged decision trees
`RegressionBaggedEnsemble`	Regression ensemble grown by resampling

主题

Ensemble Algorithms
Learn about different algorithms for ensemble learning.
Framework for Ensemble Learning
Obtain highly accurate predictions by using many weak learners.
Train Regression Ensemble
Train a simple regression ensemble.
Test Ensemble Quality
Learn methods to evaluate the predictive quality of an ensemble.
Select Predictors for Random Forests
Select split-predictors for random forests using interaction test algorithm.
Ensemble Regularization
Automatically choose fewer weak learners for an ensemble in a way that does not diminish predictive performance.
Bootstrap Aggregation (Bagging) of Regression Trees Using TreeBagger
Create a TreeBagger ensemble for regression.
Use Parallel Processing for Regression TreeBagger Workflow
Speed up computation by running TreeBagger in parallel.
Detect Outliers Using Quantile Regression
Detect outliers in data using quantile random forest.
Conditional Quantile Estimation Using Kernel Smoothing
Estimate conditional quantiles of a response given predictor data using quantile random forest and by estimating the conditional distribution function of the response using kernel smoothing.
Tune Random Forest Using Quantile Error and Bayesian Optimization
Tune quantile random forest using Bayesian optimization.
Predict Responses Using RegressionEnsemble Predict Block
Train a regression ensemble model with optimal hyperparameters, and then use the RegressionEnsemble Predict block for response prediction.
Manually Perform Time Series Forecasting Using Ensembles of Boosted Regression Trees
Manually perform single-step and multiple-step time series forecasting with ensembles of boosted regression trees.