How to avoid getting negative values when training a neural network?

2020 1 18
2 个回答
回答已采纳
更新时间：2020 1 30
9 次查看（30 天）

0 个投票

Is there anyway to constrain the network results when we train a feed forward neural network in Matlab?
I am trying to train a supervised feed forward neural network with 100,000 observations. I have 5 continues variables and 3 countinues responses (labels). All my values are positive (labels and variables). However, when I train the network, sometimes it predicts negative results no matter what architecture I use. Negative results does not have any physical meaning and should not apear. Is there anyway to constrain the network? I also used reLU activation function for the last layer but the network cannot generalize well.
Thanks

请先登录，再回答此问题。

 采纳的回答

Mostafa Nakhaei
Mostafa Nakhaei 2020-1-30

1 个投票

I found the answer for my problem. The main reason for getting negative results after I trained and tested the dataset with positive numbers was that the distribution of new dataset was different from those of train and test samples. They had more noise. In my case, the solution was not to change the activation functions of the last layer (it leaded to physically meaningless results) but to add some syntatic random noise to my dataset. This robusted the model against the noise.
Thanks
Mostafa

更多回答（1 个）

Greg Heath
Greg Heath 2020-1-18

0 个投票

Use a sigmoid for the output layer.
Hope this helps
THANK YOU FOR FORMALLY ACCEPTING MY ANSWER
GREG

1 个评论
显示 -1更早的评论 隐藏 -1更早的评论

Mostafa Nakhaei
Mostafa Nakhaei 2020-1-18
Thanks Greg for the response.
This is the regression problem and also I guess sigmoid would give negative results as well.r

请先登录，再进行评论。

类别

在 帮助中心 和 File Exchange 中查找有关 Deep Learning Toolbox 的更多信息

产品

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by