neural network fitting time to resolve

KAZ
2017 4 10
1 个回答
回答已采纳
更新时间：2017 4 12
2 次查看（30 天）

0 个投票

Dear MATLAB Gurus,
This is the first time to use MATLAB, (have experienced with SAS for nearly 20 years and for better for value solution, I decided to go with MATLAB.) Today I carried out from menu screen Neural Net Fitting. X(input) has 1.2 million rows and 475 columns. Y has 1.2 million and only two response. (1 is good and 0 is bad). I tried to optimise using Levenberg-Marquardt and performance is MSE and calculation is MEX.
My machine is i7 3.4Ghz and 16GB ram and 600GB SSD integrated. I still watching the calculation and 1 Epoch takes around 30 minues and if you set 1000 then it takes 30*1000=30000 minutes??
I just wonder if this is the right estimate to see the results and if any of you have better parameter setting etc, please advise me.
just attaching a picture of iterations for you to understand easier. Thank you, Kaz

请先登录，再回答此问题。

 采纳的回答

Greg Heath
Greg Heath 2017-4-11

0 个投票

Your data has the dimensions
[ I N ] = size(input) % [475 1.6M ]
[ O N ] = size(target) % [ 2 1.6M ]
However, since
1. You rarely need more than 20 or 30 samples per dimension for training, choose Ntrn ~ 30*475
2. Default ratios are Ntst = Nval = 3*Ntrn/14
3. You only need
N ~ 10*Ntrn/7 ~ 300*475/7 ~ 20,400
4. Although you have enough data to design about 1.6M/20.4K ~ 80 nets, combining the outputs from 10 or 20 should suffice.
Hope this helps.
Thank you for formally accepting my answer
Greg

2 个评论
显示 无 隐藏 无

Greg Heath
Greg Heath 2017-4-11
Of course you could also use dimensionality reduction techniques to reduce the dimensionality 475 before applying the above strategy.
Greg
KAZ
KAZ 2017-4-12
Hi Greg, Thanks very much for you insight. Actually, what I mistook was I chose neural fit not the pattern recognition. I tried patter recognition and found it converges fairly quickly.
And off course your insight is very useful too for the efficient model development. I am not very familiar with MATLAB yet and need to learn more characteristic of the tools. As you also mentioned, it is quite handy to reduce the dimension as well after knowing the data well but for the moment I just want to stick to the original data's output before using principal components etc etc.

请先登录，再进行评论。

更多回答（0 个）

类别

在 帮助中心 和 File Exchange 中查找有关 Deep Learning Toolbox 的更多信息

产品

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by