Simple Highway Network example from scratch.

版本 1.0.1 (4.9 KB) 作者: Lyes Demri
This is a very basic Highway Network example comparing its performances with a Feedforward Neural Network.
0.0
(0)
4.0 次下载
更新时间 2022/12/21

查看许可证

This program implements the highway network described in [Srivastava 2015] . It compares the performances of a highway network with that of a feedforward neural network on a similar problem which simply consists of distinguishing between 3 data points. It confirms the fact that highway networks continue to have good performances even for higher numbers of hidden layers, as shown in the following image.
Every step of the gradient calculation is provided in the grad_highway_layer. function

引用格式

Lyes Demri (2024). Simple Highway Network example from scratch. (https://www.mathworks.com/matlabcentral/fileexchange/122362-simple-highway-network-example-from-scratch), MATLAB Central File Exchange. 检索时间: .

MATLAB 版本兼容性
创建方式 R2009a
兼容任何版本
平台兼容性
Windows macOS Linux
标签 添加标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

版本 已发布 发行说明
1.0.1

Changed the metric with which to judge performance to MSE which makes a lot more sense.
1.0.0