Differences between svmtrain and fitcsvm

13 次查看（过去 30 天）
Diver
Diver 2015-7-9
回答： Victor Vergara 2020-10-13
I have a set of data composed of list of 35 features. I notice when I give the data to svmtrain I get the message:
no convergence achieved within maximum number of iterations
Than, when I increase the number if iteration " MaxIter " up to around 1,000,000 the above error disappear and I start getting good classification using " svmclassify ".
On the other hand, when I give the data to " fitcsvm " it converge quickly within the default number of iteration "15,000". However, the problem is when I try to classify the data using " predict ", I got wrong classification.
So in a nutshell, at last " svmtrain " classify the data correctly after increasing number of iteration. However," fitcsvm " neither classify the data correctly, nor it gives me the opportunity to increase number of iteration because it looks from checking the ConvergenceInfo.Converged property that it converge successfully.
Any advice please? notice I'm new to matlab and SVM.

请先登录，再回答此问题。

采纳的回答

Ilya
Ilya 2015-7-10
Look at the doc/help for fitcsvm or, alternatively look at the ConvergenceInfo property in the returned object. There are several tolerances. Pass low values of these tolerances to fitcsvm, say 1e-10. This usually ensures that optimization runs until the max number of iterations is met. You can then resume if desired.
Or try a different solver such as 'isda'. If you have a thousand observations or less, try 'l1qp' which dispatches to quadprog (this requires Optimization Toolbox installed).
  4 个评论
显示 2更早的评论
Diver
Diver 2015-7-15
I tried to set the parameters: - DeltaGradientTolerance. - GapTolerance - KKTTolerance - Gap
I notice when I set these values to value such as 1e-100 it return with Converged SVM (ConvergenceInfo.Converged =1). However, the result is un satisfying at all compared to SVMTRAIN.
When I decrease the parametrs to value such as 1e-400, it doesn't converge even if I resume it with 'Iterationlimit' up to 10,000,000
Is there any other parameters I could set? please advice.
Ilya
Ilya 2015-7-16
You could set lots of parameters. What are you trying to accomplish?
If you want to fit an accurate model, the box constraint and kernel scale for non-linear kernels are the two common tuning knobs. Also, try both SMO and ISDA solvers. The fact that optimization does not converge doesn't mean the model is not accurate.
If you are saying that no matter what you do, a model fitted by svmtrain is more accurate than the one fitted by fitcsvm, I'd like to take a look at your data. Can you post it somewhere?

请先登录，再进行评论。

更多回答（1 个）

Victor Vergara
Victor Vergara 2020-10-13
I am having exactly the same problem. fitcsvm and fitclinear do not perform as well as svmtrain. I changed the convergence tolerances of fitcsvm and didn't work. I would like to see how was this solved.

类别

在 Help Center 和 File Exchange 中查找有关 MATLAB 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by