How can I implement Dual LSTM in matlab?

Question

Narayan 2024-6-26，9:35

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2132116-how-can-i-implement-dual-lstm-in-matlab

评论： Narayan 2024-7-3，10:10

I want to implement dual LSTM network in matlab. How can i do it ? When I run this code, i get error as :

"Network: Invalid input layers. Network must have at most one sequence input layer".

How can i solve it? I would be grateful for your quick solution.

My objective is to train different types of features with seperate LSTM models and concatenate the outputs for fully connected layer to get single classification output.

Is it possible in matlab ?

inputSize1 = 4;

inputSize2 = 20;

numClasses = 5;

layers1 = [ ...

sequenceInputLayer(inputSize1, 'Name', 'input1')

lstmLayer(64, 'OutputMode', 'last', 'Name', 'lstm1')

dropoutLayer(0.2, 'Name', 'dropout1')

fullyConnectedLayer(64, 'Name', 'fc1')];

layers2 = [ ...

sequenceInputLayer(inputSize2, 'Name', 'input2')

lstmLayer(64, 'OutputMode', 'last', 'Name', 'lstm2')

dropoutLayer(0.2, 'Name', 'dropout2')

fullyConnectedLayer(64, 'Name', 'fc2')];

combinedLayers = [ ...

concatenationLayer(1, 2, 'Name', 'concat')

fullyConnectedLayer(64, 'Name', 'fc_combined')

reluLayer('Name', 'relu')

fullyConnectedLayer(numClasses, 'Name', 'fc_final')

softmaxLayer('Name', 'softmax')

classificationLayer('Name', 'classification')];

lgraph = layerGraph();

lgraph = addLayers(lgraph, layers1);

lgraph = addLayers(lgraph, layers2);

lgraph = addLayers(lgraph, combinedLayers);

lgraph = connectLayers(lgraph, 'fc1', 'concat/in1');

lgraph = connectLayers(lgraph, 'fc2', 'concat/in2');

plot(lgraph);

options = trainingOptions('adam', ...

'InitialLearnRate', 0.001, ...

'MaxEpochs', 10, ...

'MiniBatchSize', 32, ...

'Shuffle', 'once', ...

'Plots', 'training-progress', ...

'Verbose', false);

net = trainNetwork(Normalized_data, y_train, lgraph, options);

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Shivansh 2024-6-29，12:44

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2132116-how-can-i-implement-dual-lstm-in-matlab#answer_1478611

Hi Narayan,

It seems like you want to train sepeerate LSTM models in MATLAB.

The "trainNetwork" function doesn't support multiple sequence input layers directly.

I will recommend creating two seperate LSTM networks for different features, combining their outputs and using a custom training loop instead of the "trainNetwork" function to train the network.

I can see in your code that you are aware of the methods to achieve the first two steps. Please refer to the following MATLAB documentation for more information about the "custom training loop".

https://www.mathworks.com/help/deeplearning/ug/train-network-using-custom-training-loop.html.

I hope this resolves your issue!

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Narayan 2024-7-3，10:10

Thank you for your suggestions. Would you please provide me idea/document about the custom training with validation data. I could not found any proper document about dual input LSTM and custom trianing in Matlab. It seems easier in Pytorch to do it due to proper documentation. So. I ask your help for custom training for LSTM in matlab. Thank you

请先登录，再进行评论。