Semantic Segmentation using Deep Learning: Does MATLAB's SegNet implementation support dropout layers?
1 次查看(过去 30 天)
显示 更早的评论
MATLAB introduced SegNet in 2017b with segnetLayers. I would like to add dropout layer (s) to reduce over fitting. Does MATLAB's SegNet support this? If so, where should the layers be added?
Some SegNet architectures support dropout layers such as Bayesian SegNet. How could MATLAB's SegNet be transformed into this? If this is not easily doable, should we expect to see this added in 2018a?
I'd greatly appreciate any help you may provide!
0 个评论
回答(2 个)
Arthur Fernandes
2017-11-7
Hi Chase, I'm working on something similar here. From my understanding in DNN you can use dropout layers after your connected layers. The dropout will randomly select some of the output from the previous layer to go as input on the next layer. So, you can use it after ReLU layers or fully connected layers in the end of the process of image segmentation. Now from the documentation in MATLAB seen like the vgg16 for classification (not segmentation) is doing something in this sense. https://www.mathworks.com/help/nnet/ref/vgg16.html
Hope this helps.
0 个评论
Eric Psota
2018-1-1
编辑:Eric Psota
2018-1-1
I've also been experimenting with dropouts in a SegNet-like architecture. You can put them in after the each of the convolutional layers (side note: the DenseNet paper recommends not using them after the first convolution), and this will probably help with overfitting. The problem is that, when using for testing, the dropout is removed and all the values propagated along the network get amplified. The proper thing to do, if using a 50% dropout, would be to scale the convolutional coefficients by 0.5 after training is complete. I could be wrong, but it doesn't look like Matlab is doing this, hence the amplified values. For classification problems, amplification might not cause any problems, but this is certainly an issue with regression.
0 个评论
另请参阅
类别
在 Help Center 和 File Exchange 中查找有关 Image Data Workflows 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!