What is the activation in an LSTM and fully connected layer?

Question

Christos Chrysafis 2018-7-9

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/409542-what-is-the-activation-in-an-lstm-and-fully-connected-layer

回答： Astarag Chattopadhyay 2018-7-25

In the documentation, it is not clear what is the activation after an lstm or a fully connected layer. In an example the structure of the network was the following: -Sequence input -LSTM layer -LSTM layer -Fully Connected Layer -Regression Layer

Someone had a similar question and the verified answer was that the activations can be imported as individual layers (e.g reluLayer) but in the example above there are no reluLayers or something similar which means that the activations must be already inside the layers (e.g inside the LSTM layer). Could someone tell me what are those activations and if it is possible to change them?

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Christos Chrysafis 2018-7-10

I am using my gpu to train the network and I have seen that cudnn is used in that case and the activation used in cudnn files for lstm is tanh.

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Astarag Chattopadhyay 2018-7-25

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/409542-what-is-the-activation-in-an-lstm-and-fully-connected-layer#answer_330222

Hi Christos,

Long Short-Term Memory networks have tanh and sigmoid as the internal activation functions. You can see more details on that in the following documentation page:

https://in.mathworks.com/help/nnet/ug/long-short-term-memory-networks.html