Choose Optimizer and Learning Rate in neural network

Question

Phuong Huynh 2022-5-26

编辑： Jayanti 2024-10-18

Hi everyone, I try to find and specify optimizer and learning rate in my custom network (I am using net=network(), I refer Edit Shallow Neural Network Properties - MATLAB & Simulink (mathworks.com) )

But I can't see parameter or instruction about change optimizer (adam, sgd,...) and learning rate for my training

Can you show me where are they or Can i specify them in my network?

Thank you so much!

Katy 2023-7-20

Is there a solution for this? I'd also like to know how to change the learning rate for a shallow neural network.

Thanks!

Answer 1

Jayanti 2024-10-18

编辑：Jayanti 2024-10-18

Hi Phoung,

You can use the "trainFcn" property of the “net” to select one of the optimisers available.

net.trainFcn = 'traingd';

Refer to the official documentation below for list of all optimisers available:

In response to your query to change learning rate you can use the below code:

net.trainParam.lr=0.01;

I hope this helps.