How to regularize a machine learning algorithm or a function with respect to some data points that I have chosen on my own

Question

Luca 2022-10-20

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1831828-how-to-regularize-a-machine-learning-algorithm-or-a-function-with-respect-to-some-data-points-that-i

回答： ag 2023-9-12

I have a set of points that I use as a training set on which then a regression will be built, at this point I want to regularize the regression with respect to points that I choose. in the 1D case the idea is to fit a line on a few points, then add more points and correct the slope of the line( lasso algorithm), but I have no idea how to do that because in matlab I can't find this option as I only have the cross validation option, instead I want to choose my validation set on which to regularize the regression.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

ag 2023-9-12

在 MATLAB Online 中打开

Hi Luca,

I understand that you need to use specific data points of your choice as the validation set for your regression model.

There are multiple ways to achieve this, some of them are

You can split your dataset into ‘training’, ‘validation’, and ‘testing’ sets according to your requirements before feeding it to the model.

The code snippet below demonstrates how to split a dataset into 70% for training, 15% for validation, and 15% for testing:

[r,c] = size(dataset) ;  
split1 = 0.70 ; split2 = 0.85 ; %split percentages 
idx = randperm(r) ; %to shuffle the rows 
m = round(split1*r) ; n = round(split2*r) ; 
Training = dataset(idx(1:m),:) ;  
Validation = dataset(idx(m+1:n),:) ;  
Testing = dataset(idx(n+1:end),:) ; 

You can use the ‘cvpartition’ MATLAB function.
You can utilize the ‘Set aside a test data set’ feature in the ‘Regression Learner App’.

For more details, please refer the following MATLAB documentation

https://www.mathworks.com/help/stats/cvpartition.html
https://www.mathworks.com/help/stats/train-regression-model-using-hyperparameter-optimization-in-regression-learner-app.html

Hope this helps! 

Best Regards, Aryan Gupta 