Simple Highway Network example from scratch.

版本 1.0.1 (4.9 KB) 作者: Lyes Demri

This is a very basic Highway Network example comparing its performances with a Feedforward Neural Network.

关注

0.0

(0)

4.0 次下载

更新时间 2022/12/21

查看许可证

This program implements the highway network described in [Srivastava 2015] . It compares the performances of a highway network with that of a feedforward neural network on a similar problem which simply consists of distinguishing between 3 data points. It confirms the fact that highway networks continue to have good performances even for higher numbers of hidden layers, as shown in the following image.

Every step of the gradient calculation is provided in the grad_highway_layer. function

引用格式

Lyes Demri (2024). Simple Highway Network example from scratch. (https://www.mathworks.com/matlabcentral/fileexchange/122362-simple-highway-network-example-from-scratch), MATLAB Central File Exchange. 检索来源 2024/7/28.