Data pre-processing function in ANN model

2 次查看（过去 30 天）
Shing Mei Chiew
Shing Mei Chiew 2022-10-21
编辑： Shing Mei Chiew 2022-12-2
I need to use ANN model to formulate explicit equations for predicting my data output. I preprocessed my raw data where I normalised my input variables using min-max normalization and logarithmic transformation for my output variable. After that, only I fed the data into the neural network tool in MATLAB. However, after finished training the network, only I realised that the neural network model has built-in preprocessing function which preprocess the input data and post process the output data automatically within the network. Nevertheless, the results from the training and testing is desirable and satisfactory.
Since the ANN has its built-in data preprocessing function, is the first data preprocessing step unneccessary or is it okay to have data preprocessing (manually) before feeding the data into the neural network?

请先登录，再回答此问题。

采纳的回答

Ben
Ben 2022-12-1
Are you using the Deep Learning Toolbox tools such as DAGNetwork, dlnetwork, trainNetwork and/or custom training loops? In that case the preprocessing is defined by the input layer and can be turned off, for example imageInputLayer(inputSize,Normalization="none")
If that isn't the case could you let us know which network and training functions you are using?
Whether or not it is OK to manually preprocess and let the network also do preprocessing will depend on the particular preprocessing being done. For example if you manually scale the data into the interval [0,1] then it makes no difference if the network training also does this (since the data will already be in [0,1] if you manually preprocessed).
  1 个评论
Shing Mei Chiew
Shing Mei Chiew 2022-12-2
编辑：Shing Mei Chiew 2022-12-2
Thank you for your response. I did not use deep learning but only fitnet for estimation. I use tansig transfer function in the hidden layer, and purelin for the output layer.
I scale my input data manually to [0,1] initially with the following equation:
(x-xmin)/(xmax-xmin)
and output data with logarithmic function because of the skewness of data:
log(y+1) with range [1,8]
After I feeded in my "Scaled data" to the network, the preprocessed function in ANN scale my data to [-1,1] with mapminmax function.
Is it considered double job and it is no need to carry out preprocessing manually?
Yet I get a quite good accuracy and estimation.

请先登录，再进行评论。

更多回答（0 个）

类别

在 Help Center 和 File Exchange 中查找有关 Build Deep Neural Networks 的更多信息

标签

产品


版本

R2022b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by