Understanding the equations behind the 'logistic' learner when using fitclinear

1 次查看（过去 30 天）
Brian Odegaard
Brian Odegaard 2017-6-9
评论： Ilya 2017-6-12
I recently performed two-class predictions using the "fitclinear" function in MATLAB, implementing the "logistic" learner.
In the description of the "learner" input argument, the documentation for fitclinear lists only a single equation for regression:
f(x) = Bx + b
This equation only applies to linear regression, and not the logistic learner option. Would it be possible to list/describe the equations that yield the predictions when using the logistic learner? The description of the loss function in this section is informative, but I would appreciate seeing an explicit description of the logistic function.

请先登录，再回答此问题。

采纳的回答

Ilya
Ilya 2017-6-9
predict help:
If the linear classification model consists of logistic regression learners, then the software applies the 'logit' score transformation to the raw classification scores (see ScoreTransform).
Then click on ScoreTransform.
  2 个评论
Brian Odegaard
Brian Odegaard 2017-6-9
Thank you!
One quick follow-up: Is there a standard way to rank features when implementing the logistic learner in this function? I am aware of several options for feature ranking in MATLAB but am not sure which method is best to incorporate with fitclinear.
Ilya
Ilya 2017-6-12
Use lasso regularization with a small step in the regularization parameter and record what features survive at what lambda. As you increase regularization, you will get less features. The order in which feature coefficients drop to zero determines the feature ranks. Something like this would do:
lambda = logspace(-8,2,100);
mdl = fitclinear(X,y,'Learner','logistic','Lambda','lambda','Regularization','lasso','Solver','sparsa');
You may need to adjust the range of lambda for your problem.

请先登录，再进行评论。

更多回答（0 个）

类别

在 Help Center 和 File Exchange 中查找有关 Support Vector Machine Regression 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by