Use of penalty multiplier C (boxconstraint) in svmtrain

2 次查看（过去 30 天）
Rupesh Gupta
Rupesh Gupta 2012-12-3
I looked up the code of svmtrain. If the algorithm is QP, it uses
[alpha, ~, exitflag, output] = quadprog(H,-ones(nPoints,1),[],[],...
groupIndex',0,zeros(nPoints,1), Inf *ones(nPoints,1),...
X0, qp_opts)
So this means that there is no upper bound on alphas.
It takes into account the boxconstraint in this fashion:
kx = feval(kfun,training,training,kfunargs{:});
% ensure function is symmetric
kx = (kx+kx')/2 + diag(1./boxconstraint);
H =((groupIndex * groupIndex').*kx);
I am unable to understand how does this enforce the box constraints:
0 < alphai < C
Thanks

请先登录，再回答此问题。

采纳的回答

Ilya
Ilya 2012-12-3
The magnitude of the margin slack vector can be shrunk using a 1-norm or 2-norm penalty. The 1-norm version seems more popular, and it gives rise to the dual formulation in which the alphas are capped by C. The QP solution in the svmtrain function however uses the 2-norm penalty. In this case, the dual problem has no upper bound on alpha and a 1/C term is added to the diagonal of the Hessian. I would agree that referring to C as "box constraint" in this case is somewhat confusing.
  1 个评论
Rupesh Gupta
Rupesh Gupta 2012-12-3
Thank you for your answer. Just want to ask one clarification question. Is there any specific technical reason why this is done? Or put another way, will I see some problems if I modify the code to keep the hessian matrix as it is, and include the box constraint as upper bound in quadprog?
Thanks again

请先登录，再进行评论。

更多回答（1 个）

Ilya
Ilya 2012-12-3
Off hand I cannot think of a reason why you couldn't use quadprog to solve the 1-norm problem. I don't know why the 2-norm solution was chosen for svmtrain. The svmtrain implementation is relatvely old. The fast 'interior-point-convex' algorithm for quadprog was introduced in 11a, years after svmtrain was coded. Whatever reasons motivated this choice for svmtrain may not hold anymore.

类别

在 Help Center 和 File Exchange 中查找有关 MATLAB 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by