How to get validation test and training errors of a neural network?

Question

Newman 2016-7-30

1
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/297765-how-to-get-validation-test-and-training-errors-of-a-neural-network

编辑： Mohamed Nedal 2019-12-14

I have created and trained a neural network using the following code .I want to know how to get the training testing and validation errors/mis-classifications the way we get using the matlab GUI.

trainFcn = 'trainscg';  % Scaled conjugate gradient backpropagation.
   % Create a Pattern Recognition Network
   hiddenLayerSize = 25;
   net = patternnet(hiddenLayerSize);
% Setup Division of Data for Training, Validation, Testing
net.divideParam.trainRatio = trainper/100;
net.divideParam.valRatio = valper/100;
net.divideParam.testRatio = testper/100; 
% Train the Network
[net,tr] = train(net,x,t);

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Greg Heath 2016-8-5

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/297765-how-to-get-validation-test-and-training-errors-of-a-neural-network#answer_230873

在 MATLAB Online 中打开

BOTH documentation commands

 help patternnet
and
 doc patternnet

have the following sample code for CLASSIFICATION & PATTERN-RECOGNITION:

    [x,t] = iris_dataset;
     net  = patternnet(10);
     net  = train(net,x,t);
     view(net)
     y = net(x);
     perf = perform(net,t,y);
     classes = vec2ind(y);

However, the following are missing

Dimensions of x and t 
Plots of x, t, and t vs x
Minimum possible number of hidden nodes
Initial state of the RNG (Needed for duplication)
Training record, tr
Plots of e = y-t vs x
Misclassified cases
trn/val/tst Error rates

For details see my NEWSGROUP posts

 SIZES OF MATLAB CLASSIFICATION EXAMPLE DATA SETS
http://www.mathworks.com/matlabcentral/newsreader/...
       view_thread/339984
 and
 BEYOND THE HELP/DOC DOCUMENTATION : PATTERNNET for 
 NN Classification and PatternRecognition
 http://www.mathworks.com/matlabcentral/newsreader/...
     view_thread/344832

Hope this helps.

Thank you for formally accepting my answer

Greg

2 个评论
显示无隐藏无

Anton Tichenko 2019-4-19

Hi Greg,

Noticed in a few answers here you are referring to "THE HELP/DOC DOCUMENTATION : PATTERNNET for NN Classification and PatternRecognition" and "SIZES OF MATLAB CLASSIFICATION EXAMPLE DATA SETS" posts

I can't find them anywhere, have they been removed? Any chance you could share again?

Thanks!

Greg Heath 2019-4-20

help and doc are to be used in the MATLAB command line. For example

>> help patternnet

patternnet Pattern recognition neural network.

...

Hope this helps

Greg

请先登录，再进行评论。

Answer 2

Greg Heath 2016-7-31

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/297765-how-to-get-validation-test-and-training-errors-of-a-neural-network#answer_230341

在 MATLAB Online 中打开

 clear all, clc
  [ x, t ] = simplefit_dataset;
  net      = fitnet;
  rng('default')      % For reproducibility
  [ net tr y e ]   =  train( net, x, t );
  %  y = net(x); e = t - y;
   tr = tr % No semicolon:  LOOK AT ALL OF THE GOODIES!!!
 msetrn = tr.best_perf
 mseval = tr.best_vperf
 msetst = tr.best_tperf