how to merge multiple losses network

3 次查看（过去 30 天）

abomad anam 2020-3-4

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/508940-how-to-merge-multiple-losses-network

评论： Redha Almahdi 2022-1-19

Hi,

I am a new user of matlab deep learning toolbox, however, I would like to build a deeply supervised networks by matlab R2019b. In these networks multiple branches from the successive hidden layers of the main network are used to optian losses (∅d in the equation bellow) at those hidden layers, the training process is required to optimize the final (first term) and intremdiate losses (second term of the equation) in order to fastly converge as shown in figure below! The Objective function is:

∅ = ∅(X,W) + ∑ L* ∅d (X;Wd;w ̃d) + γ(‖W‖^2+∑‖w ̃d ‖^2 )

where ∅ is the entropy loss.

The question is how to merge all these losses in the learning process (training loop)? is there any tutorial could be helpful to address such cases? as the direct way (using trainNetwork) accept only one final outputlayer!

Thanks,