GateActivationFunction — Activation function to apply to the gates
- 'sigmoid' – Use the sigmoid function σ(x)=(1+e−x)−1.
- 'hard-sigmoid' – Use the hard sigmoid function
no Relu fuction
╮(╯▽╰)╭
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!