How to keep constant weights in a Neural Network?

Question

Enrique Luna Villagomez 2021-6-4

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/848215-how-to-keep-constant-weights-in-a-neural-network

评论： Enrique Luna Villagomez 2021-6-5

Hi, I am trying to train only certain parameters of neural network in MATLAB 2021a, but I have not found anything related in the help menu.

I have found that it is possible to keep constant all the parameters of a certain layer by changing the layer attribute "trainable" to false, but in this case I would like to train some parameters of the layer. (Ex. There are 6 parameters in the layer and I want to fix two and train the remanining ones).

Thanks for your attention.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

SALAH ALRABEEI 2021-6-5

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/848215-how-to-keep-constant-weights-in-a-neural-network#answer_716960

在 MATLAB Online 中打开

Assume u have 5 inputs 10 ne. (for only on hidden layer). First, generate yourself a random matrix of size 5x10, then save it. Then construct the net, but before the training, replace weight with the one you manually created as follows

if true
  net.Layers(k).Weights = W;
end

where net is the name of ur ne, W is new weights, and k is the layer.

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Enrique Luna Villagomez 2021-6-5

Thanks for your answer, but if the train function is after that conditional, the weights would change at the end right ? I mean basically what I will be doing with that conditional is to initialize the weights.

请先登录，再进行评论。