How to analyse the performance of Neural Network using Neural Network Toolbox? The performance and training state graphs are attached. Kindly Check.

29 次查看（过去 30 天）
Sai Kumar Dwivedi
评论： ghulam murtaza 2022-6-14
I am using ORL face Database for face recognition. There are 40 subjects each with 10 images each. The size of each image is 112 * 92 pixels. For feature extraction and dimensionality reduction, I used 2D- PCA. The feature matrix is now 112*8.
Following is the code after feature extraction --
% TrainFaces --- shape is 240 * 112 *8 (contains 240 images (8 images of 40 persons))
% ValFaces --- shape is 80 * 112 *8 (contains 80 images (2 images of 40 persons))
% TestFaces --- shape is 80 * 112 *8 (contains 80 images (2 images of 40 persons))
% train_target -- shape is 40 * 240 (1st bit is 1 if it is 1st image and all rest zero)
% val_target -- shape is 40 * 240
% test_target -- shape is 40 * 240
EigenFaces = [TrainFaces ; ValFaces ; TestFaces];
target = [train_target val_target test_target];
%%%%%%%%%%Now we can convert feature matrix into feature vector %%%%%%%%%%%%%
input = [];
for i = 1:size(EigenFaces,1)
input = [input reshape(EigenFaces(i,:,:),size(EigenFaces,2)*size(EigenFaces,3),1)];
end
%%%%%%%%Creating Network and Training Them %%%%%%%%%%%
setdemorandstream(491218382);
net = patternnet(25);
net.divideFcn = 'divideind';
[net.divideParam.trainInd, net.divideParam.valInd, net.divideParam.testInd] = divideind(400,1:240,241:320,321:400);
net.trainFcn = 'trainrp';
[net,tr] = train(net,input,target);
%%%%%%%%%%%%%Testing the network %%%%%%%%%%%%%%%
predict = 0; % Number of correctly identified images out of 80
for i =1:80
[tar_val tar_ind] = max(test_target);
[out_val out_ind] = max(net(reshape(TestFaces(i,:,:),size(TestFaces,2)*size(TestFaces,3),1)));
if tar_ind == out_ind
predict = predict +1;
end
end
predict
The predict always shows zero.
Following is the snapshot of the result. Kindly help me analysis from the graph. Any help would be really grateful.
1. nntraintool
2. Performance
3. Training State
4. Error Histogram
  3 个评论
显示 1更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

采纳的回答

Greg Heath
Greg Heath 2015-3-5
The success of a NN design often depends on a fortunate set of random initial weights AND a reasonable value for the number of hidden nodes, H.
MY approach:
1. Begin with the default H = 10.
2. Explicitly initialize the RNG before the training loop
3. Design Ntrials = 10 or more nets in a loop. The different trials will have different random initial weights, different random trn/val/tst data divisions and different answers.
4. tr will contain various details of the training. Immediately after training the command
tr = tr
will divulge most of the important training details.
5. If none of the 10 designs are satisfactory, I introduce an outer loop over hidden node values
e.g., for h = 10:2:20, etc
6. I have posted many, many examples of the double loop design procedure in both the NEWSGROUP and ANSWERS. For classification try mixtures of the following searchwords:
greg patternnet Ntrials ind2vec tutorial
7. In your case tr.stop will indicate that training stopped because the validation error reached a minimum. This is obvious from the plots.
8. I would just start again with Ntrials = 10 or more different designs, etc
9. Use ind2vec to convert the true class indices 1:40 to the target matrix and vec2ind to convert the output to assigned class indices. Then comparing true and assigned will result in the error count.
Hope this helps.
Greg

更多回答（1 个）

Mazhar Bukhari
Mazhar Bukhari 2018-10-26
1. nntraintool This tool you know is used to train the network, it is pretty simple. 2. Performance There are four lines, Train, Validation, test and Best. In-fact, Best (dotted) line represents that other line should lie on or near this (dotted) lines, then we can be confirmed that training has been done successfully. If any of the 3 (Training, Validation and Testing) lines meet or pass near the best (dotted) line, it means convergence has been done, it this is not the case, retrain the network. 3. Training state It represents the current progress / status of the training at a specific time while training is in progress, in your case, 6 validation errors are mentioned, it means when simultaneously 6 validation check errors are produced then training will stop. Validation check error means dataset has some problems, may be some instances are not understandable by the training algorithm etc. means due to dataset problems, validation check errors can be generated. In your case, 6 validation checks are used.
Error histogram. It represents errors that approach to Mean Squared Error (MSE)
  1 个评论
ghulam murtaza
ghulam murtaza 2022-6-14
You have helped me alot again I have little bit confusion in training state what does Mu and gradient values shows which graph will be accurate. Secondly in error histogram for best graph what should be error range

请先登录，再进行评论。

类别

在 Help Center 和 File Exchange 中查找有关 Sequence and Numeric Feature Data Workflows 的更多信息

标签

产品

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by