Apply non-image data to CNN

Question

Gadelhag M Omar Mohmed 2019-3-1

1
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/447701-apply-non-image-data-to-cnn

评论： HayderMU 2022-11-2

I am trying to train a CNN with a numerical data set. Once the input data is not an image format. Assuming my data has a size of 1850*11 matrix. With a 1850*1 label (for output). In libsvm I can use it directly and in the Neural Network Toolbox (nnstart) as well.

However, in case I want to use a CNN network. The only training function is "trainNetwork" it could only support image as an input. So how could I train the CNN with my data on Matlab?

Any simple example will be appreciated.

Thanks to all of in advance.

Gad

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Shivam Gupta 2019-3-4

2
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/447701-apply-non-image-data-to-cnn#answer_363676

在 MATLAB Online 中打开

You can read in your data using the function "imageDatastore" with a custom read function.

For example,

nonImageData = imageDatastore(pathToDataFiles, 'IncludeSubfolders', true, 'LabelSource', 'foldernames', 'FileExtensions', '', 'ReadFcn', @customreader);

You can then use 'nonImageData' as you would normally use an "imageDatastore" - for example, as input to "splitEachlabel" or "trainNetwork".

Note: Be careful to watch for negative numbers, however, as some layers (ex. ReLULayer) will convert all negative values to zero.

For more information, see:

https://in.mathworks.com/help/deeplearning/ref/trainnetwork.html?s_tid=srchtitle#input_argument_d0e61395

For more Related MATLAB Answers see:

https://in.mathworks.com/matlabcentral/answers/383886-cnn-with-data_set?s_tid=prof_contriblnk

https://in.mathworks.com/matlabcentral/answers/337635-is-it-valid-to-enter-a-non-image-input-in-convolutional-neural-network-toolbox

https://in.mathworks.com/matlabcentral/answers/349616-how-to-train-a-network-with-non-image-data-mnist

9 个评论
显示 7更早的评论隐藏 7更早的评论

Shivam Gupta 2019-3-5

在 MATLAB Online 中打开

Create a readFcn1.m file and add the following function

function I = readFcn1(filename)
% Load data and get matrices from the structure
I = load(filename);
I = I.data;
end  

Copy Training_F.mat file first 21 columns to new file say 'signal.mat' and change the name of variable to 'data'. Add this file inside a directory. Update location as the absolute path to this directory.

Create another script file and add the following code to it

location = 'absolutepathtofile';
imds = imageDatastore(location, 'FileExtensions', '.mat', 'IncludeSubfolders',1, ...
                      'LabelSource','foldernames');
countEachLabel(imds);
trainingDS = imds;
% Convert labels to categoricals
trainingDS.Labels = categorical(trainingDS.Labels);
trainingDS.ReadFcn = @readFcn1;
layers = [ ...
    imageInputLayer([210 21 1])
    convolution2dLayer(5,20)
    reluLayer
    maxPooling2dLayer(2,'Stride',2)
    fullyConnectedLayer(1)
    softmaxLayer
    classificationLayer];
options = trainingOptions('sgdm', ...
    'MaxEpochs',20,...
    'InitialLearnRate',1e-4, ...
    'Verbose',false, ...
    'Plots','training-progress');
trainedNet = trainNetwork(imds,layers,options);

You can edit layers and options parameters for better train your data.

Gadelhag M Omar Mohmed 2019-3-5

在 MATLAB Online 中打开

Hi Shivam Gupta

I created a new script and named it as (prepair_data.m) and I put the code as :

clc, clear
load 'Training_F.mat';
signal= Training_F(:,1:21);
data= Training_F;

Then I save the data.mat in a directory as :

location = 'C:\Users\N0670029\Dropbox\Gadelhag\Matlab\CNN\try_ccn\Train';

And then, I created another script in the same directory with the (prepair_data.m) and named it as (save_mat_try.m) and put the code you mentioned it as :

location = 'C:\Users\N0670029\Dropbox\Gadelhag\Matlab\CNN\try_ccn\Train';
imds = imageDatastore(location, 'FileExtensions', '.mat', 'IncludeSubfolders',1, ...
                      'LabelSource','foldernames');
countEachLabel(imds);
trainingDS = imds;
% Convert labels to categoricals
trainingDS.Labels = categorical(trainingDS.Labels);
trainingDS.ReadFcn = @readFcn1;
layers = [ ...
    imageInputLayer([210 21 1])
    convolution2dLayer(5,20)
    reluLayer
    maxPooling2dLayer(2,'Stride',2)
    fullyConnectedLayer(1)
    softmaxLayer
    classificationLayer];
options = trainingOptions('sgdm', ...
    'MaxEpochs',20,...
    'InitialLearnRate',1e-4, ...
    'Verbose',false, ...
    'Plots','training-progress');
trainedNet = trainNetwork(imds,layers,options);

but, I getting this error :

Error using trainNetwork (line 154)
The training images are of size 210x22x1 but the input layer expects images of size 210x21x1.
Error in save_mat_try (line 22)
trainedNet = trainNetwork(imds,layers,options);
Caused by:
    Error using nnet.internal.cnn.util.NetworkDataValidator/assertCorrectDataSizeForInputLayer (line 262)
    The training images are of size 210x22x1 but the input layer expects images of size 210x21x1.

Any suggestions, please.

Thanks in advance

Gad

Shivam Gupta 2019-3-5

Hi Gad,

Have you followed this "Copy Training_F.mat file first 21 columns to new file say 'signal.mat' and change the name of variable to 'data'."

For your training only first 21 columns are required not the 22nd column.

Gadelhag M Omar Mohmed 2019-3-5

Hi

I got it now. I will try it and let you know. Thanks Sir for your time and help.

Regards

Gad

请先登录，再进行评论。

Answer 2

Zia Uddin Ahmed Zihan 2019-6-21

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/447701-apply-non-image-data-to-cnn#answer_380307

Hi Shivam,

I am also struggling with the same. My problem is I want to run the numerical data alongside each image to improve image classification accuracy. I ran my code according to your suggestion. However, how am I supposed to know if MATLAB is taking the image and numerical data correctly simultaneously?

Thanks,

Zia

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

Answer 3

Abdullah Bittar 2020-5-25

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/447701-apply-non-image-data-to-cnn#answer_438518

Hi Guys,

I am also trying to train CNN using non image data. I followed the steps that were published by Shivam Gupta but was not seccussful. I am having the following problem.

Error using trainNetwork (line 150)

The training images are of size 1x1x1 but the input layer expects images of size 137x14x1.

Error in save_mat_try (line 22)

trainedNet = trainNetwork(imds,layers,options);

I sparated my input datafrom my output (target data) into two separate mat files. My input data has 14 colunms and 137 rows. Therefore it is the size of [137 14 1].

I have my imageInputLayer as imageInputLayer([137 14 1]

I tried searching for a solution for my probelm but i didnt find any solution. I would truley appreciate the help.

Thank you

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

Answer 4

Omar Almasarani 2021-4-20

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/447701-apply-non-image-data-to-cnn#answer_680287

Hi,

I followed the answer of Shivam and it run but this in only input data without target. how do you define the target data?

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

HayderMU 2022-11-2

Exactly

I followed the code. The code NEVER LOADS THE CLASSES.

So it's training just on the fly. The last column which contains the target classes is comlpetely excluded. THe network is training on itself just to do nothing bcause no target classes are loaded.

请先登录，再进行评论。

Apply non-image data to CNN

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

采纳的回答

9 个评论
显示 7更早的评论隐藏 7更早的评论

更多回答（3 个）

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

另请参阅

类别

标签

产品

Community Treasure Hunt

Apply non-image data to CNN

0 个评论 显示 -2更早的评论隐藏 -2更早的评论

采纳的回答

9 个评论 显示 7更早的评论隐藏 7更早的评论

更多回答（3 个）

0 个评论 显示 -2更早的评论隐藏 -2更早的评论

0 个评论 显示 -2更早的评论隐藏 -2更早的评论

1 个评论 显示 -1更早的评论隐藏 -1更早的评论

另请参阅

类别

标签

产品

Community Treasure Hunt

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

9 个评论
显示 7更早的评论隐藏 7更早的评论

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

1 个评论
显示 -1更早的评论隐藏 -1更早的评论