Data format error with training a ResNet for semantic segmentation

Question

Jannik Menke 2024-9-2

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2149544-data-format-error-with-training-a-resnet-for-semantic-segmentation

评论： Jannik Menke 2024-9-10

I am trying to train a ResNet for the purpose of a pixel classification problem with two classes. The data consists of 256x256 RGB images, groundtruth is 256x256 Categorical. However there seems to be a conflict of data formats in regard to the final softmax layer of the network. Here is an excerpt from my code along with the error message.

input_size = [256 256 3];
numClasses = 2;
resNet = resnetNetwork(input_size, numClasses);
options = trainingOptions('adam', ...
    'InitialLearnRate',1e-3, ...
    'MaxEpochs',30, ... 
    'MiniBatchSize',64, ...
    'Metrics','accuracy', ...
    'Plots','training-progress', ...
    'ValidationFrequency',25, ...
    'ValidationData',validationData);
trainedResNetGreen = trainnet(trainingData,resNet,@(Y,T) modelLoss(Y,T,classWeights),options);

Error using trainnet (line 46)

Error forming mini-batch of targets for network output "softmax". Data interpreted with format "BC". To specify a different format,

use the TargetDataFormats option.

Error in ResNetGreen (line 37)

trainedLCUnetGreen = trainnet(trainingData,resNet,@(Y,T) modelLoss(Y,T,classWeights),options);

Caused by:

Batch dimension of datastore must match the format batch dimension (1).

I already tried to specify the Target Data Format as "SSBC" which corresponds to "Spatial, Spatial, Batch, Channel" but it did not fix the problem. Am I missing something?

2 个评论
显示无隐藏无

Matt J 2024-9-2

Since the problem is in the data format, we need to see the data you are giving it.

Jaimin 2024-9-3

Hi @Jannik Menke,

Could you please provide relevant data for better understanding?

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Milan Bansal 2024-9-9

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2149544-data-format-error-with-training-a-resnet-for-semantic-segmentation#answer_1513234

Hi Jannik Menke,

From the mentioned error, I understand that the program is not able to minibatches due to differences in data formats while performing semantic segmentation using resnetNetwork.

By default, resentNetwork gives you a neural network equivalent to Resnet-50, which can only be used for classification instead of semantic segmentation. Due to this reason, the model expects the target to be a categorical array, hence the output layer of the model has "BC" data format. You can verify this using the analyzeNetwork function. The target data provided by you are label images, which will have the data format "SSBC" and will not be compatible with the model.

If you wish to use the Resnet Network for semantic segmentation, you will need to modify the model manually. Instead, it is better to use the inbuilt models in MATLAB, which can use Resnet as the backbone. You can use deeplabv3plus, which can have the Resnet-18 or Resnet-50 as the backbone.

Please refer to the following documentation links to learn more about resnetNetwork and deeplabv3plus.

Please refer to the following documentation links to learn more about resnetNetwork and deeplabv3plus and analyzeNetwork.

Hope this helps!

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Jannik Menke 2024-9-10

I already figured out that the problem originates from the spatial information getting lost as this specific Resnet is intended for classification. I almost came to terms with having to modify the model manually but your recommendation of deeplabv3plus comes very handy. Thank you very much!

请先登录，再进行评论。

Data format error with training a ResNet for semantic segmentation

2 个评论
显示无隐藏无

采纳的回答

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

更多回答（0 个）

另请参阅

类别

标签

产品

版本

Community Treasure Hunt

Data format error with training a ResNet for semantic segmentation

2 个评论 显示 无隐藏 无

采纳的回答

1 个评论 显示 -1更早的评论隐藏 -1更早的评论

更多回答（0 个）

另请参阅

类别

标签

产品

版本

Community Treasure Hunt

2 个评论
显示无隐藏无

1 个评论
显示 -1更早的评论隐藏 -1更早的评论