Deep learning regression network improvements?

2020 3 16
1 个回答
回答已采纳
更新时间：2020 3 19
2 次查看（30 天）

0 个投票

Hi all.
I'm trying to train a deep learning model giving me as responses the curves I attached.
The skeleton of the simple model is attached, too.
How could I improve the network to obtain better results?
I'm wondering why the model is not able to reach the same order of magnitude of the training data (the attached images represents only few of the similar curves used for the training).
I tried increasing or reducing the size of the single layers, I tried to add more layers with a smaller size, but the result is still the same.
The input sequences are a representation of the initial conditions and wind velocity for each curve and it is recognizing the shape of the curves but not their magnitudes.
Thank you in advance.

请先登录，再回答此问题。

 采纳的回答

Mahesh Taparia
Mahesh Taparia 2020-3-19
编辑：Mahesh Taparia 2020-3-19

0 个投票

Hi
By looking at your network design, it seem that you are having input data with dimension of 4 and trying to regress the output. You are taking the number of hidden nodes as 1000/2000 from 4 as input and converting back to 1 from 2000 nodes, which is not recomended. You can go with something like 4->8->16->32->16->8->1 (it deepend upon number of hidden layers you put). Try with different optimization techniques like adam/ sgdm, batch size, learning rate, number of hidden layers/nodes, input data normalization etc. Hope it will help.

3 个评论
显示 1更早的评论 隐藏 1更早的评论

Giacomo Notaro
Giacomo Notaro 2020-3-19
Hi,
Thank you for the answer, in these days I worked to improve the model in the way you can see in the attached images.
I need to have the 4 inputs in order to define the initial conditions of the curves I'm trying to reproduce, in the same way I need only one output, hence I can't adopt the 4-8-16-32-16-8-4, since I need one sequence as output.
I improved the model by putting more networks in parallel as you can see in the picture attached, each column differs from the others by the learning rate. Which is coming from 1 of the first column to 6 at the last.
I will try to get better results trying to optimize also other features.
Mahesh Taparia
Mahesh Taparia 2020-3-19
Yeah try different optimization techniques and it was some form of 4->8->16->32->16->8->1.

请先登录，再进行评论。

更多回答（0 个）

类别

在 帮助中心 和 File Exchange 中查找有关 Deep Learning Toolbox 的更多信息

产品

版本

R2019b

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by