Channel-wise convolution deep learning layer for 1d and 3d data i.e. groupedConvolution1dLayer, groupedConvolution3dLayer

Question

Artem Lensky 2023-4-26

1
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1952999-channel-wise-convolution-deep-learning-layer-for-1d-and-3d-data-i-e-groupedconvolution1dlayer-grou

编辑： Artem Lensky 2023-4-26

I am looking to implement a layer for channel-wise convolution similar to groupedConvolution2dLayer(filtSize, 1, "channel-wise"...). Unfortunately there are no 1D and 3D analogs of groupedConvolution2dLayer.

Any recommendations would be helpful?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Matt J 2023-4-26

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1952999-channel-wise-convolution-deep-learning-layer-for-1d-and-3d-data-i-e-groupedconvolution1dlayer-grou#answer_1223219

A 1D image is a special case of a 2D image, so you should be able to use groupedConvolution2dLayers for the 1D case.

3 个评论
显示 1更早的评论隐藏 1更早的评论

Artem Lensky 2023-4-26

编辑：Artem Lensky 2023-4-26

Matt, thank you for the prompt response! Very much appreciated.

The input data for 1D case are 1D signals (in principal of different length, that is why I chose sequenceInputLayer as input layer). The tensor that is passed to the convolution layer is of "CBT" shape. To make it compatible with groupedConvolution2dLayer, I implemented two simple layers (cbt2sscbLayer and sscb2cbtLayer) that map "CBT" to "SSCB" and then "SSCB" to "CBT". So the network is organized in the following way

[...

cbt2sscbLayer()...

groupedConvolution2dLayer([recSize 1], 1, "channel-wise")...

sscb2cbtLayer()...

instanceNormalizationLayer()...

]

The mapping layers imlement method predict as follows

% cbt2sscbLayer

function Z = predict(layer, X)

idx = finddim(X, "T");

numSamples = X.size(idx(1));

idx = finddim(X, "C");

numChannels = X.size(idx);

idx = finddim(X, "B");

if(isnan(X.size(idx)))

numBatches = 1;

else

numBatches = X.size(idx);

end

X = dlarray(X,'UUU');

Z = ones(numSamples, 1, numChannels, numBatches);

Z(:,1,:,:) = permute(X, [3, 1, 2]);

Z = dlarray(Z,'SSCB');

end

and

% sscb2cbtLayer

function Z = predict(layer, X)

idx = finddim(X, "S");

numSamples = X.size(idx(1));

idx = finddim(X, "C");

numChannels = X.size(idx);

idx = finddim(X, "B");

if(isnan(X.size(idx)))

numBatches = 1;

else

numBatches = X.size(idx);

end

X = X.reshape([numSamples, numChannels, numBatches]);

X = dlarray(X,'UUU');

Z = X.permute([2 3 1]);

Z = dlarray(Z,'CBT');

end

Unfortunately the model is not able to learn.

Do I need to implement function backward? Any recommendations would be apprecitated.

Artem Lensky 2023-4-26

UPDATE: The solution above seemed to work for 1D signals. It didn't work inititally because of some hyperparameter that is not relevant to the implementation above.