Neural network for regression that has mulitple outputs of different order
2 次查看(过去 30 天)
显示 更早的评论
Hello, I am asking to see if there is any advice to create the neural net that has multiple outputs (for regression) with differnt order(say one of output has order of 10^-5, while the other output has order of 10^5).
Is there any tips for this? Shall I have to make seperate neural nets for each of those outputs?
Thank you very much!
0 个评论
采纳的回答
Varun Sai Alaparthi
2022-11-16
I understand that you want to effectively train a regression model with multiple output heads and the outputs are of different orders.
My advice would be to use weights while adding L2 regression losses. This would normalise the magnitude effect caused due to difference in order.
For example:
Loss = Loss1*W1+Loss2*W2;
% If Loss1 s order > Loss2’s order W1<W2 (example: W1 = 0.001, W2=1)
Here W1 and W2 can be treated as hyper parameters and can be tuned accordingly for effective training.
Please refer to the following link for implementing custom training loop and loss function with weights for multiple outputs:
Please try this and reach out to us for any further issues.
Sincerely
Varun
更多回答(0 个)
另请参阅
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!