Hello Juuso,
I see that you are trying to perform dimensionality reduction on 3D volumes before performing SVM classification.
As you have rightly done, the scores for the predictor variables, XS, should be used for training the SVM classifier. However, when you want to apply the PLS model to new data, like your test data XTest, you need to calculate the scores for this new data based on the loadings XL. The correct way to do this is not by simply multiplying XTest by XL but by mean-centering the test data using the mean of the training data and then projecting onto the loadings XL. By centering the test data with the same mean used for the training data, you ensure that the projection onto the PLS components (XL) is consistent with the model built from the training data. Please refer to the documentation to learn more about PLS algorithm: https://www.mathworks.com/help/stats/plsregress.html#:~:text=see%20Algorithms.-,Algorithms,-plsregress%20uses%20the
Please refer to the code snippet attached below illustrating the modified workflow:
% Cross-validation (train: 70%, test: 30%)
cv = cvpartition(size(X,1),'HoldOut',0.3);
idx = cv.test;
% Separate to training and test data
XTrain = X(~idx,:);
YTrain = Y(~idx, :);
XTest = X(idx,:);
YTest = Y(idx, :);
% Perform PLS regression to get the scores for the training data
nComponents = 10;
[XL,~,XS,~,~,~,~] = plsregress(XTrain,YTrain,nComponents);
% Train SVM using the scores from PLS
SVMModel = fitcsvm(XS,YTrain,'Standardize',true,'KernelFunction','RBF',...
'KernelScale','auto');
% Perform k-fold cross-validation and compute the loss
CVSVMModel = crossval(SVMModel);
classLoss = kfoldLoss(CVSVMModel);
% Calculate the scores for the test data
XTestCentered = bsxfun(@minus, XTest, mean(XTrain)); % Center the test data
XTestScores = XTestCentered * XL; % Calculate the scores for the test data
% Predict using the SVM model and the test scores
[label,~] = predict(SVMModel, XTestScores);
% Calculate accuracy
accuracy = mean(label == YTest);
As for the performance of SVM on the training data, there can be several reasons. Some of the potential issues to consider are:
- The number of PLS components chosen might not be optimal. Too few components might not capture enough variance, while too many might include noise. Try adjusting the number of components to see if it improves performance.
- The choice of kernel function and its parameters can greatly affect SVM performance. You're using the RBF kernel; make sure that the 'KernelScale' parameter is appropriate for your data. You can try a grid search over kernel parameters to find the best combination.
- The SVM might not be complex enough to capture the patterns in the data, or it might be too regularized. You can experiment with different machine learning classifiers to find a better fit.
Hope it helps!
