Learning Rate Drop Period

Question

Serhii Bahdasariants 2020-4-3

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/514988-learning-rate-drop-period

评论： Serhii Bahdasariants 2020-4-9

采纳的回答： Srivardhan Gadila

Hi!

I am using the 'trainNetwork' function for my net training.

Is there any way to set the 'LearnRateDropPeriod' to be less than 1 epoch? I need it to be updated more frequently.

Thanks in advance!

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Srivardhan Gadila 2020-4-5

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/514988-learning-rate-drop-period#answer_424147

For most tasks, you can control the training algorithm details using the trainingOptions and trainNetwork functions. If the trainingOptions function does not provide the options you need for your task (for example, a custom learn rate schedule), then you can define your own custom training loop using automatic differentiation.

For an example showing how to train a network with a custom learn rate schedule, see Train Network Using Custom Training Loop.

Refer to Define Custom Training Loops, Loss Functions, and Networks, Solver Options.