DLnetwork definition and training problem with outputLayer

Question

undefined undefined 2024-4-26

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2112261-dlnetwork-definition-and-training-problem-with-outputlayer

回答： Lucas García 2024-5-11

I need to use dlnetwork (in order to export it to ONNX format).

I have defined its layers as follows:

layers = [

sequenceInputLayer(202,"Name","sequence")

fullyConnectedLayer(25,"Name","fc")

fullyConnectedLayer(2,"Name","fc_1")

softmaxLayer("Name","softmax")];

and then I defined the net:

nett = dlnetwork(layers);

so until here everything is fine.

When I am trying to train the network:

[net,tr] = trainNetwork(DATA,Alllabels, layers, options);

I get the following error:

Network: Missing output layer. The network must have at least one output layer.

Layer 'softmax': Unconnected output. Each layer output must be connected to the input of another

layer.

So I redefined my layers to include an ouput layer:

layers = [

sequenceInputLayer(202,"Name","sequence")

fullyConnectedLayer(25,"Name","fc")

fullyConnectedLayer(2,"Name","fc_1")

softmaxLayer("Name","softmax")

classificationLayer()];

but now the definition of the network as before (nett = dlnetwork(layers) ) returns the following error:

Layer 'classoutput': Detected output layer. The network must not have output layers.

So this is kind of a catch-22 problem - I need to add an output layer to train the network, but I must remove an output layer for defining it!!

Does someone have clue?

Thanks

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Abhinav Aravindan 2024-5-8

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2112261-dlnetwork-definition-and-training-problem-with-outputlayer#answer_1454282

在 MATLAB Online 中打开

I understand that you are trying to train a deep learning network and export the trained network as an “ONNX” file but facing an issue in defining and training the network. While utilizing “dlnetwork”, the layers cannot contain an output layer.

The network input to “exportONNXNetwork” need not be a “dlnetwork” object. “layers” array can be utilized directly as an input to “trainNetwork” for training the neural network. The output of “trainNetwork” can then be exported as an “ONNX” file as given below. Kindly note that this is with respect to MATLAB R2023a.

% Define your network layers 
layers = [ 
    sequenceInputLayer(202,"Name","sequence") 
    fullyConnectedLayer(25,"Name","fc") 
    fullyConnectedLayer(2,"Name","fc_1") 
    softmaxLayer("Name","softmax") 
    classificationLayer()];  
% Replace with your data and required training options 
net = trainNetwork(data,layers,options);  
% Export trained network as ONNX file 
exportONNXNetwork(net, filename.onnx) 

Please find below the documentation links for your reference.

dlnetwork: https://www.mathworks.com/help/releases/R2023a/deeplearning/ref/dlnetwork.html?s_tid=doc_ta#mw_daaa19ab-3b04-4a1a-b5e8-38095a7cac38:~:text=The%20network%20layers%20must%20not%20contain%20output%20layers.

trainNetwork: https://www.mathworks.com/help/releases/R2023a/deeplearning/ref/trainnetwork.html

exportONNXNetwork: https://www.mathworks.com/help/releases/R2023a/deeplearning/ref/exportonnxnetwork.html?s_tid=doc_ta#mw_844c3879-ae5e-4704-8595-20250a86a2ef

I hope this helps resolve your issue!

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

Answer 2

Lucas García 2024-5-11

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2112261-dlnetwork-definition-and-training-problem-with-outputlayer#answer_1455936

You should use the trainnet function instead of trainNetwork to train dlnetwork objects. That said, you can convert the Series or DAG network trained with trainNetwork if you are using R2024a by using dag2dlnetwork .