Create custom people detector for automated labelling on own specific dataset

Question

Candice Earley 2021-10-1

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1464844-create-custom-people-detector-for-automated-labelling-on-own-specific-dataset

评论： Mahesh Taparia 2021-10-8

I have applied the built-in ACFpeopleDetector for automated labelling on my own dataset of people in a rail station (not upright still images) and it is not very accurate. I have also tried to create and train a custom ACFobjectDetector (307 training images for 3075 dataset) but is not an improvement. Is there a way to pre-process (like instance segmentation) a dataset of people in a rail station to make the labelling more accurate? The dataset is people walking through a specific area at an overhead angle and thus the frames are not perfectly still images of people and many times with people behind one another.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Mahesh Taparia 2021-10-4

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1464844-create-custom-people-detector-for-automated-labelling-on-own-specific-dataset#answer_801341

Hi

In order to label the objects, you can use image labeler app with custom algorithm option.The custom algorithm can be YOLOv3/ FasterRCNN/ any deep learning network pretrained on COCO dataset. For more information on custom algorithm approach, you can refer to this documentation and this example. Try to use YOLO3,it may work in your case.

Hope it will help!

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

Answer 2

Candice Earley 2021-10-6

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1464844-create-custom-people-detector-for-automated-labelling-on-own-specific-dataset#answer_803031

I am having trouble actually importing those various detectors into ImageLabeler. I have tried to run the matlab examples for creating a rcnnmask but the examples gives errors such as "unrecognized variable or function segmentObjects" and tried loading a pretrained RCNN gives "variable 'net' orginally saved as maskrcnn cannot be instantiated as an object and will be read as an unint32".

Could you possibly assist? Where can I find the necessary files to import those detectors in ImageLabeler? (since can't be .mat files and should be .m I assume)

3 个评论
显示 1更早的评论隐藏 1更早的评论

Mahesh Taparia 2021-10-7

在 MATLAB Online 中打开

Hi

You can use a custom algorithm option while doing labeling, for example you can use YOLOv3 in your case as follows:

Save the below code in your current working directory,
Select this file as automation algorithm in image/video labeler
Click on automate button, it will create prediction as per YOLOv3 (you can use any other algorithm in place of that).
Adjust the prediction if they are not proper.
Save/ export the labels as gTruth object.

classdef MyCustomAlgorithmForLabeling < vision.labeler.AutomationAlgorithm & vision.labeler.mixin.Temporal
    properties(Constant)
        % Name: Give a name for your algorithm.
        Name = 'Example YOLOv3 Algorithm';
        % Description: Provide a one-line description for your algorithm.
        Description = 'This is an example of a custom automation algorithm.';
    
        UserDirections =  {...
            vision.labeler.AutomationAlgorithm.getDefaultUserDirections('selectroidef', vision.getMessage('vision:labeler:People')),...
            vision.labeler.AutomationAlgorithm.getDefaultUserDirections('rundetector', vision.getMessage('vision:labeler:People')),...
            vision.labeler.AutomationAlgorithm.getDefaultUserDirections('review'),...
            vision.labeler.AutomationAlgorithm.getDefaultUserDirections('rerun'),...
            vision.labeler.AutomationAlgorithm.getDefaultUserDirections('accept')...
            };
    end
  
    properties
        %------------------------------------------------------------------
        % Place your code here
        %------------------------------------------------------------------
        detector
        SelectedLabelName
    end
    methods
 
        function isValid = checkLabelDefinition(~, labelDef)
            %--------------------------------------------------------------
            % Place your code here
            isValid = (labelDef.Type == labelType.Rectangle);
            %--------------------------------------------------------------
        end
    end
  
    methods
        
        function initialize(algObj, I, labelsToAutomate)
%             disp(['Executing initialize on the first image frame at ' char(seconds(algObj.CurrentTime))])
            %--------------------------------------------------------------
            % Place your code here
            %--------------------------------------------------------------
            algObj.detector = yolov3ObjectDetector('darknet53-coco');
        end
        %
        function autoLabels = run(algObj, I)
            autoLabels = [];
            %--------------------------------------------------------------
            % Place your code here
            %--------------------------------------------------------------
            I = im2double(I);
            [bboxes, scores, labels] = detect(algObj.detector,I);
            idx = labels=='person';
            
            personBox = bboxes(idx,:);
%             personScores{i,1} = scores(idx);
            personLabel = labels(idx);
            if(~isempty(personLabel))
                autoLabels.Name = algObj.SelectedLabelDefinitions.Name;
                autoLabels.Position = personBox;
                autoLabels.Type = labelType.Rectangle;
          
            end
        end
        function terminate(algObj)
            disp('Executing terminate')
        end
    end
end

Hope it will help!

Candice Earley 2021-10-7

Hi. Thank you for the code. I have saved it as a .m file and tried to import it into the algorithm selection in ImageLabeler but get an error "MyCustomAlgorithmForLabeling is not an automation algorithm". I am currently using Matlab 2021b and have all the necessary toolboxes downloaded so I am not sure why I am not even able to run Matlab examples sucessfully.

Mahesh Taparia 2021-10-8

Can you share a screenshot of error?

请先登录，再进行评论。

Create custom people detector for automated labelling on own specific dataset

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

回答（2 个）

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

3 个评论
显示 1更早的评论隐藏 1更早的评论

另请参阅

类别

标签

产品

版本

Community Treasure Hunt

Create custom people detector for automated labelling on own specific dataset

0 个评论 显示 -2更早的评论隐藏 -2更早的评论

回答（2 个）

0 个评论 显示 -2更早的评论隐藏 -2更早的评论

3 个评论 显示 1更早的评论隐藏 1更早的评论

另请参阅

类别

标签

产品

版本

Community Treasure Hunt

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

3 个评论
显示 1更早的评论隐藏 1更早的评论