How to use a Leaky Relu/Softmax function in a hidden layer in a Feedforward Neural Network?

Question

Ihsan Ullah 2019-4-3

1
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/454042-how-to-use-a-leaky-relu-softmax-function-in-a-hidden-layer-in-a-feedforward-neural-network

回答： Abhishek Tiwari 2022-7-10

Hi.

I am using a feedforward neural network with an input, a hidden, and an output layer. I want to change the transfer function in the hidden layer to Leakyrelu but the usual command (given below for a poslin transfer function) is not working

net.layers{1}.transferFcn = 'poslin'; % this command is working for poslin

Please suggest the command for changing the transfer function in layer 1 to a leakyrelu. Kindly also suggest the command to change the output layer transfer function to a softmax in a feedforward neural network.

Thank you

Ihsan

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Abhishek Tiwari 2022-7-10

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/454042-how-to-use-a-leaky-relu-softmax-function-in-a-hidden-layer-in-a-feedforward-neural-network#answer_1003820

在 MATLAB Online 中打开

Hi,

The following is a list of all relevant transfer functions:

%     compet - Competitive transfer function.
%     elliotsig - Elliot sigmoid transfer function.
%     hardlim - Positive hard limit transfer function.
%     hardlims - Symmetric hard limit transfer function.
%     logsig - Logarithmic sigmoid transfer function.
%     netinv - Inverse transfer function.
%     poslin - Positive linear transfer function.
%     purelin - Linear transfer function.
%     radbas - Radial basis transfer function.
%     radbasn - Radial basis normalized transfer function.
%     satlin - Positive saturating linear transfer function.
%     satlins - Symmetric saturating linear transfer function.
%     softmax - Soft max transfer function.
%     tansig - Symmetric sigmoid transfer function.
%     tribas - Triangular basis transfer function.
net.layers{1}.transferFcn = 'poslin';