Hi . I am new to DNN. I use deep neural network for binary classification but returns all zeros or ones.

Question

Tommy Bear 2020-2-19

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/506348-hi-i-am-new-to-dnn-i-use-deep-neural-network-for-binary-classification-but-returns-all-zeros-or-o

评论： Daniel Vieira 2020-2-26

采纳的回答： Daniel Vieira

data.mat

在 MATLAB Online 中打开

I've tried using machine learning approach(SVM, KNN, Tree...) and the accuracy is good.

I am interested in transfer learning so I want to build a deep learning model.

The attached picture is my training data, column 1 to 9 are features and the marked column(10) is the response which will be changed into categorical vector for training.

And here's my code for network training.

And my data for training is attached ༼ •̀ ں •́ ༽ Thanks

layers = [
    sequenceInputLayer(9,"Name","sequence")
    fullyConnectedLayer(12,"Name","fc_1")
    reluLayer("Name","relu_1")
    fullyConnectedLayer(96,"Name","fc_3")
    reluLayer("Name","relu_2")
    fullyConnectedLayer(48,"Name","fc_4")
    reluLayer("Name","relu_3")
    fullyConnectedLayer(2,"Name","fc_2")
    softmaxLayer("Name","softmax")
    classificationLayer("Name","classoutput")];
options = trainingOptions('adam', ...
    'InitialLearnRate',0.01, ...
    'LearnRateSchedule','piecewise',...
    'MaxEpochs',30, ...
    'ValidationData',{xtest,ytest}, ...
    'ValidationFrequency',3, ...
    'MiniBatchSize',1024, ...
    'Verbose',1, ...
    'Plots','training-progress');

4 个评论
显示 2更早的评论隐藏 2更早的评论

Srivardhan Gadila 2020-2-21

@Tommy Bear, is the issue regarding DNN's accuracy?

Tommy Bear 2020-2-21

Yeah the accuracy is bad since the responses are all the same(ones) for arbitrary predictors.

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Daniel Vieira 2020-2-21

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/506348-hi-i-am-new-to-dnn-i-use-deep-neural-network-for-binary-classification-but-returns-all-zeros-or-o#answer_416737

I recommend normalizing your predictors, they range from 10^-5 to 10^9, pretty insane. I'd rather work with the log10 of that (ranging from -5 to 9).

I would also change the sequence input layer to an imageInputLayer with size [1 9], and possibly adapt the way you give the input data. The sequence input layer is meant for the LSTM model, not your case. The imageInputLayer, although meant for images, works just fine with vectors and matrices of any sort.

3 个评论
显示 1更早的评论隐藏 1更早的评论

Tommy Bear 2020-2-25

Oh seems my validation data was wrong dimension and I fixed it.

But the accuracy won't improve as long as reach around 80%, any suggestion for improving results?

Daniel Vieira 2020-2-26

it may be because your data is unbalanced, like Srivardhan Gadila said below. When it's too unbalanced, the network will nearly always answer in favor of the most frequent label, effectively "capping" accuracy, and mistaking all the less frequent labels. You should select equal (or nearly equal) ammounts of observations for each label. It should improve your accuracy.

请先登录，再进行评论。

Answer 2

Srivardhan Gadila 2020-2-25

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/506348-hi-i-am-new-to-dnn-i-use-deep-neural-network-for-binary-classification-but-returns-all-zeros-or-o#answer_417210

Seems that your dataset is unbalanced, count of sequences with label 0 is 59695 and with label 1 is 94226. This could make the learning of the network biased to label 1. Please refer to Prepare and Preprocess Data & Deep Learning Tips and Tricks for more information.

For normalization of data you can make use of the of 'Normalization' & 'NormalizationDimension' Name-Value pair arguments of the sequenceInputLayer or imageInputLayer.