leave one person out cross validation

Question

pallavi patil 2021-8-19

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1436929-leave-one-person-out-cross-validation

回答： Prince Kumar 2021-9-7

i have dataset which contains data from 10 subject. My idea fir cross validaytion is leave one person out cross validation. Here i trian on data from 9 subjects and test on data from 1. When we normally do cross validation, we have a stopping criteria which avoids model overfitting.

How do I avoid overfittiing in my case.

below is code snippet

for idx = 1:N%k = LOOCV train on rest; validate on K- meal
    s = [1:idx-1 idx+1:N];
    Xtrain= Training(s); %(all remaining datasets)
    Xvalidate = Training(idx);% idx dataset
    Xtrainlabel = Training_labels(s);
    Xvalidatelabel = Training_labels(idx);
    Mdl = fitcsvm(XTrain(:,featsel),...
        XTrainlabel);
    [trainSVM,trainScoreSVM] = resubPredict(Mdl); %training
    %- Cross-validate the classifier
    CVSVMModel = crossval( Mdl );
    %validation
    Yval_pred= predict(Mdl, XValidate(:, featsel)); %validation
    [cmV,order] = confusionmat(Yval_pred, actual_val);
    tnV = cmV(1,1);
    fnV = cmV(1,2);
    fpV = cmV(2,1);
    tpV = cmV(2,2);
    Accuracy(idx) = (tp+fp)./(tp+fp+tn+fn);
end