L1 and L2 Regularization for matlab

Question

Abdussalam Elhanashi 2019-10-17

1
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/485977-l1-and-l2-regularization-for-matlab

回答： Divya Gaddipati 2019-10-21

Hi Guys

I would like to know how to add regularization L1 & L2 for following layers to reduce overfitting

 imageInputLayer([32 32 3],"Name","imageinput")
    convolution2dLayer([5 5],32,"Name","conv","BiasLearnRateFactor",2,"Padding",[2 2 2 2],"WeightsInitializer","narrow-normal")
    batchNormalizationLayer
    maxPooling2dLayer([3 3],"Name","maxpool","Stride",[2 2])
    preluLayer(20,'prelu')
    averagePooling2dLayer([3 3],"Name","avgpool","Stride",[2 2])
    fullyConnectedLayer(2,"Name","fc_rcnn","BiasL2Factor",1,"BiasLearnRateFactor",10,"WeightLearnRateFactor",20,"WeightsInitializer","narrow-normal")
    dropoutLayer(0.65,'Name','drop1')
    softmaxLayer("Name","softmax")
    classificationLayer("Name","classoutput")];