Adam Optimizer with feedforward nueral networks

Question

Manos Kav 2018-4-30

1
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/398294-adam-optimizer-with-feedforward-nueral-networks

评论： Bob 2022-11-18

Hello, is there any way to use Adam optimizer to train a neural network with the "train" fucntion? Or a way to use this implementation ( https://www.mathworks.com/matlabcentral/fileexchange/61616-adam-stochastic-gradient-descent-optimization ) to train the network?

Thanks in advance.

2 个评论
显示无隐藏无

Abdelwahab Afifi 2020-6-14

Have you get the answer ?

Bob 2022-11-18

did anyone of you guys got the answer?

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Hrishikesh Borate 2020-6-19

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/398294-adam-optimizer-with-feedforward-nueral-networks#answer_453940

在 MATLAB Online 中打开

Hi,

It’s my understanding that you want to use Adam optimizer to train a neural network. This can be done using trainNetwork function, and setting the appropriate Training Options.

For eg.,

[XTrain,~,YTrain] = digitTrain4DArrayData;
layers = [ ...
    imageInputLayer([28 28 1])
    convolution2dLayer(12,25)
    reluLayer
    fullyConnectedLayer(1)
    regressionLayer];
options = trainingOptions('adam', ...
    'InitialLearnRate',0.001, ...
    'GradientThreshold',1, ...
    'Verbose',false, ...
    'Plots','training-progress');
net = trainNetwork(XTrain,YTrain,layers,options);
[XTest,~,YTest] = digitTest4DArrayData;
YPred = predict(net,XTest);
rmse = sqrt(mean((YTest - YPred).^2))

For more information, refer to trainNetwork.

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Abdelwahab Afifi 2020-6-19

'trainNetwork' is used for Deep learning neural network. But I think he wanna use 'Adam optimizer' to train shallow neural network using 'train' function.

请先登录，再进行评论。