How to deploy trained Faster RCNN object detector in Simulink

2 次查看（过去 30 天）
HAMMED OBASEKORE
HAMMED OBASEKORE 2019-2-13
编辑： Arkadiy Turevskiy 2021-10-28
Kindly assist me on how to use my trained Faster RCNN object detector in Simulink.
I have trained a Faster RCNN object detector in matlab, however, I am having difficulty in getting resources and way point on how to use it in simulink.
I humbly need urgent response.

请先登录，再回答此问题。

回答（2 个）

Patel Mounika
Patel Mounika 2019-2-22
编辑：Patel Mounika 2019-2-22
There is no direct way to use Faster RCNN object detector in Simulink but instead you can use coder.extrinsic to wrap the call to object detector inside a MATLAB Function block.
You can refer to below link to know more about coder.extrinsic:https://www.mathworks.com/help/fixedpoint/ref/coder.extrinsic.html
For example, the MATLAB Function block can be defined as follows:
function[bboxes,scores]= function(I)
coder.extrinsic('detect');
coder.extrinsic('evalin');
[bboxes,scores] = evalin('base','detect(detector,I)'); % detector is fasterRCNNObjectDetector and I is image.
Hope this helps.
  2 个评论
HAMMED OBASEKORE
HAMMED OBASEKORE 2019-2-22
Thanks so much for the response. It came in when I almost gave up on it.
However, I actualy did that, but, I received errors when loading the detector (fasterRCNNObjectDetector) from the .mat file I saved.
function y = fcn(u)
%#codegen
coder.extrinsic('load');
coder.extrinsic('detect');
persistent detector
if(isempty(detector))
cnnn = load('C:\Users\OBAS\Pictures\Building_Insect_Set\trained\matlab_detector_vgg19_mAP0.81%250epochs.mat');
detector = cnnn.detector;
end
kk = zeros(50,1);
[bboxes,scores] = detect(detector,u);
for i=1:size(scores)
kk(i)=scores(i);
end
y = kk;
%% The Errors
Attempt to extract field 'detector' from 'mxArray'.
Function 'MATLAB Function' (#98.256.260), line 10, column 16:
"cnnn"
Launch diagnostic report.
Component:MATLAB Function | Category:Coder error
Persistent variable 'detector' must be assigned before it is used. The only exception is a check using 'isempty(detector)' that can be performed prior to assignment.
Function 'MATLAB Function' (#98.319.327), line 14, column 26:
"detector"
Launch diagnostic report.
Component:MATLAB Function | Category:Coder error
...
Is there anyway around these errors.
HAMMED OBASEKORE
HAMMED OBASEKORE 2019-3-6
Thanks Patel I eventually got it to work. Here is the correct function inside Matlab Function block in simulink
function [count, bbox ,prob] = fcn(I)
%#codegen
% ensure to initialize your trainned FasterRCNN in the workspace
% I is the Image
coder.extrinsic('evalin')
coder.extrinsic('assignin')
kk= zeros(50,1,'double');
prob = zeros(50,1,'double');
bbox = zeros(50,4,'double');
k=0;
assignin('base','u',I)
[bboxes, scores, cat] = evalin('base','detect(detector,u)')
N = size(scores)
k = N(1)
count = k;
for i = 1:50
if(~isempty(k))
if i > k
break;
end
end
kk(i) = scores(i);
bbox(i,:) = bboxes(i,1:4);
end
prob = kk;

请先登录，再进行评论。

Arkadiy Turevskiy
Arkadiy Turevskiy 2021-10-18
编辑：Arkadiy Turevskiy 2021-10-28
As of R2021b you can use Deep Learning Object Detector block in Computer Vision Toolbox. For mpre information please see Deep Learning in Simulink page in documentation.

类别

在 Help Center 和 File Exchange 中查找有关 Object Detection 的更多信息

标签

产品

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by