evaluateDetectionPrecision error when using my own dataset

Question

Timothy Kain 2017-4-29

1
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/337930-evaluatedetectionprecision-error-when-using-my-own-dataset

编辑： gyenist 2021-4-27

I am trying to use evaluateDetectionPrecision for an iteration of a multiclass RCNN that I have previously made with my own data. I am receiving the following error:

Error using vision.internal.detector.evaluationInputValidation>checkDetectionResultsTable (line 75) The label value in row 1 of the detection results table is undefined. It must be one of the following categorical values: {Warship,Mil_Aircraft}.

In my detection results, the categorical values used for labels are indeed 'Warship' and 'Mil_Aircraft'.

I'm not sure where I am going wrong in adapting the DeepLearningFasterRCNNObjectDetectionExample code for my data.

5 个评论
显示 3更早的评论隐藏 3更早的评论

OIPA 2018-7-12

The same error for me. I have checked and the label of the detection result is the defined one...

Has anyone solved this problem?

Udari De Alwis 2019-3-16

Having the same issue with multi class labels. Appreciate if anyone can share a successful solution for this problem ?

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Anirudh TOPIWALA 2018-11-10

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/337930-evaluatedetectionprecision-error-when-using-my-own-dataset#answer_346230

Even I have the same problem. Can anyone please help?

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Walter Roberson 2018-11-10

Could you indicate what we would need to do in order to reproduce this?

请先登录，再进行评论。

Answer 2

Sara Perez 2019-2-20

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/337930-evaluatedetectionprecision-error-when-using-my-own-dataset#answer_361927

编辑：Sara Perez 2019-2-21

Hi!

I have the same problem. It works fine for calculating the accuracy of a single class (where ground truth does not need label information) as the example shown in the documentation.

But for several categories I got the error. "The label value in row 1 of the detection results table is undefined. It must be one of the following categorical values: {car,people}."

I just comment the error message line of matlab internal function (line 80 in evaluationInputValidation.m) and it seems to work fine and return the accuracy scores. More concretely this line of code:

error(message('vision:ObjectDetector:undefinedLabelInDetectionTable', i, msg));

The internal function can be found in: MATLAB\R2018b\toolbox\vision\vision\+vision\+internal\+detector

Hope it helps!

Sara.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

Answer 3

gyenist 2021-4-27

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/337930-evaluatedetectionprecision-error-when-using-my-own-dataset#answer_685850

编辑：gyenist 2021-4-27

在 MATLAB Online 中打开

Hello!

The problem is that the input sanity checker for the builtin evalution function gets the ground truth classes from only the first row of the gt table like this:

classes = categories(data{1,2});

So if the detection results have different classes from the first gt row the above error is displayed. If you comment the error message as suggested by @Sara Perez the error will no longer diplay, but the evalution score calculation will only be done for the classes in the first gt row.

Other workarounds to get no error and scores for all classes (in 2020b at least) are

to use different table format for your input data as mentioned in https://uk.mathworks.com/help/vision/ref/evaluatedetectionprecision.html - Input Arguments
to change the code that gets the class ctegories in line 15 of MATLAB\R2020b\toolbox\vision\vision\+vision\+internal\+detector\evaluationInputValidation.m to

classes = categories(vertcat(data{:,2}));

P.S: I'm not sure if this is already fixed in Matlab 2021 versions. Hope I could help!

Best,

gyenist