How can I trust my result which is changing according to train,test and validation set choice in NeuralNetwork?

1 次查看（过去 30 天）
seulki120
seulki120 2022-1-10
回答： Prince Kumar 2022-1-21
Hi, Now I'm using the NeuralNetwork Pattern recognition.
In my case, I have a 60 subjects x 700 features data, and it has 2 class labels.
Using dividerand Function, I separated the subjects with train 70%, test 15%, validation 15%
As the result, The accuracy always changes according to subject select in train, test and validation set.
How can I trust my result which is changing according to train,test and validation set choice in NeuralNetwork ?
As I know, model performance will be trust throught the divided train, test and validation set.
Then, I can used the max accuracy ?
of After the repeat, and using the average of results?
I need the help, please..!
thank you !

请先登录，再回答此问题。

回答（1 个）

Prince Kumar
Prince Kumar 2022-1-21
Hi,
This generally happens when you do not have a pre-defined train, validation and test set for training and testing the model. As you keep changing the data distribution between these sets, the result will vary accordingly. In such cases try to do a k-fold cross validation.
Please refer to the following documentations for more clarity
Hope this helps!

类别

在 Help Center 和 File Exchange 中查找有关 Deep Learning Toolbox 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by