Is it possible to implement a LSTM layer after a CNN layer?
6 次查看(过去 30 天)
显示 更早的评论
I'm trying to implement a CNN layer + a LSTM layer, but I have an error: "Network: Incompatible layer types". Is it not possible to implement this combination in MATLAB or am I just writing it not properly?
My code:
layers = [ ...
sequenceInputLayer(inputSize)
convolution2dLayer(3,8,'Padding','same')
batchNormalizationLayer
reluLayer
maxPooling2dLayer(2,'Stride',2)
lstmLayer(numHiddenUnits,'OutputMode','last')
fullyConnectedLayer(numClasses)
softmaxLayer
classificationLayer
];
Error:
Error using trainNetwork (line 154)
Invalid network.
Caused by:
Network: Incompatible layer types. The network contains layer types not supported with recurrent layers.
Detected recurrent layers:
layer 6 (LSTM)
Detected incompatible layers:
layer 2 (Convolution)
layer 3 (Batch Normalization)
layer 5 (Max Pooling)
Layer 2: Input size mismatch. Size of input to this layer is different from the expected input size.
Inputs to this layer:
from layer 1 (output size 500)
采纳的回答
Mona
2018-9-19
As far as I know, no, you can't combine the two. You can train a CNN independently on your training data, then use the learned features as an input to your LSTM. However, learning and updating CNN weights while training an LSTM is unfortunately not possible.
1 个评论
krishna Chauhan
2020-6-26
Maam can i store the weights after say a number of epochs of CNN and then use those weights as input to LSTM?
更多回答(4 个)
charu
2018-7-9
use bilstmLayer layer instead of lstm layer as in example
inputSize = 12;
numHiddenUnits = 100;
numClasses = 9;
layers = [ ...
sequenceInputLayer(inputSize)
bilstmLayer(numHiddenUnits,'OutputMode','last')
fullyConnectedLayer(numClasses)
softmaxLayer
classificationLayer]
1 个评论
Guillaume JUBIEN
2018-9-3
I have the same problem by using a bilstm Layer. The error message is :
if true
Error using trainNetwork (line 154)
Invalid network.
Error in test_spa_REG (line 168)
net = trainNetwork(XTR,TTR,Layers,options);
Caused by:
Network: Incompatible layer types. The network contains layer types not supported with recurrent layers.
Detected recurrent layers:
layer 9 (BiLSTM)
Detected incompatible layers:
layer 1 (Image Input)
layer 2 (Transposed Convolution)
layer 'temp1' (Convolution)
layer 5 (Average Pooling)
and 1 other layers.
Layer 10: Input size mismatch. Size of input to this layer is different from the expected input size.
Inputs to this layer:
from layer 9 (output size 20)
Is it possible to combine CNN with LSTM layer ?
Shounak Mitra
2019-7-11
Hello Everyone,
As of 19a, MATLAB supports workflows containing both CNN and LSTM layers.
Please check the link that contains an example showing the CNN+LSTM workflow --> https://www.mathworks.com/help/deeplearning/examples/classify-videos-using-deep-learning.html
2 个评论
Bhavna Rajasekaran
2019-11-8
编辑:Bhavna Rajasekaran
2019-11-8
Is it possible to implement LSTM regression on an image (N-by-M array) such that the output is also a 2-dimesional array? Which means that the Predictors are an N-by-M array of sequences?
sotiraw sotiroglou
2019-3-24
Matlab 2019a is out. And it claims it can do this cnn - rnn combination.
Could someone give us an example?
0 个评论
sotiraw sotiroglou
2019-3-24
Matlab 2019a is out there , and it claims it can do this rnn cnn combination.
I dont know the details, but i write this answer to encourage everyone with the same issue to search and maybe help with an example
0 个评论
另请参阅
类别
在 Help Center 和 File Exchange 中查找有关 Image Data Workflows 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!