Coverage report from unit tests is inaccurate

2021 6 16
1 个回答
更新时间：2022 3 18
11 次查看（30 天）

0 个投票

Using the matlab.unittest.plugins.CodeCoveragePlugin with class-based unit tests produces coverage reports that are not always accurate. I see them repeatedly (but not always) occur when function handles are split across multiple lines. The following image provides an example (code to reproduce it is attached).
The "missed line" goes away if you replace isequal(x) with x == x in line 4. Also, if you just remove the ellipsis and have the function handle defined entirely on one line, the report does not display a "missed line."

请先登录，再回答此问题。

回答（1 个）

Neeraj Badamikar
Neeraj Badamikar 2021-6-17

1 个投票

Hello Micah,
Thank you for reporting this. We've had a few other users reporting about this issue and we are working on addressing it.
One possible solution we're looking at is to report code coverage on entire MATLAB statements as opposed to lines. That would ensure that a statement like this -
function_handle_with_wrapping_line_for_isequal = @(x) ~isequal(x, x) || ...
isequal(x, x);
would either be marked as covered or not covered in entirety.
Is that something that you would find useful?
Regards,
Neeraj

4 个评论
显示 2更早的评论 隐藏 2更早的评论

Micah Fry
Micah Fry 2021-6-17
My main concern is seeing a reported "lack of coverage" when there isn't one. That messes with the code coverage metrics as well. Whether the report is by statement or by line, as long as I'm not seeing erroneous red lines (and getting lower coverage percentages), my issue is resolved.
The example was purposefully made to illustrate that the execution MUST be going through the last line (even though it reports that the line wasn't touched). So if the MATLAB's reporting plugin continues to focus on lines rather than statements, a fix would need to show 100% coverage of the example I provided.
Neeraj Badamikar
Neeraj Badamikar 2021-6-17
Thank you for your feedback, Micah.
Micah Fry
Micah Fry 2021-6-17
Is there a bug tag I can keep track of for this issue? It looks like this may be related to another question (https://www.mathworks.com/matlabcentral/answers/575389-some-lines-missed-in-code-coverage-report).
Micah Fry
Micah Fry 2022-3-18
I see with R2022a this issue is fixed! Thanks @Neeraj Badamikar!

请先登录，再进行评论。

类别

在 帮助中心 和 File Exchange 中查找有关 Verification, Validation, and Test 的更多信息

产品

版本

R2020b

标签

提问:

Micah Fry
Micah Fry
2021-6-16

评论：

Micah Fry
Micah Fry
2022-3-18

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by