error using trainNetwork and minibatchqueue, on a multi-inputs (sequence and feature) network

Question

辰铭 2024-10-25

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2162030-error-using-trainnetwork-and-minibatchqueue-on-a-multi-inputs-sequence-and-feature-network

评论：辰铭 2024-11-3

A multi-inputs(sequence and feature) data is constructed below, the sequence input (XTrain1) is 1347*1 cell and each cell is a 7*31 double; the feature input (XTrain2) is 1347*80 double; the output is 1347*1 categorical (only the data structure matters, so the details are replaced with random numbers).

% Clear variables and close figures
clear; clc; close all;
% Generate example data (simulating real data)
N = 1347;  % Number of samples
T = 31;    % Time steps
F_time = 7;  % Number of time series features
F_static = 80;  % Number of static features
% Time series input (1347 samples, each sample is 7*31)
XTrain1 = cell(N, 1);
for i = 1:N
    XTrain1{i} = rand(T, F_time)';  % Each sample is a 7*31 matrix
end
% Static feature input (1347 samples, each sample has 80 dimensions)
XTrain2 = rand(N, F_static);  % 1347x80 matrix
% Classification labels (assuming binary classification)
YTrain = categorical(randi([1, 2], N, 1));  % Binary classification problem
% Convert XTrain1 (time series data) to arrayDatastore
ds1 = arrayDatastore(XTrain1, 'OutputType', 'cell');  % Time series data in cell format
% Convert XTrain2 (static feature data) to arrayDatastore
ds2 = arrayDatastore(XTrain2, 'OutputType', 'cell');  % Static feature data as numerical array format
% Convert YTrain (labels) to arrayDatastore
dsY = arrayDatastore(YTrain, 'OutputType', 'cell');  % Labels in categorical format
% Create a combined datastore, combining multiple inputs into one multi-input data stream
trainDs = combine(ds1, ds2, dsY);

the network is constructed below

%% Define the network

lgraph = layerGraph();

tempLayers = [

sequenceInputLayer(7,"Name","input","Normalization","zerocenter")

lstmLayer(128,"Name","lstm","OutputMode","last")

dropoutLayer(0.5,"Name","dropout")];

lgraph = addLayers(lgraph,tempLayers);

tempLayers = [

featureInputLayer(8,"Name","featureinput")

fullyConnectedLayer(64,"Name","fc_1")];

lgraph = addLayers(lgraph,tempLayers);

tempLayers = [

concatenationLayer(1,2,"Name","concat")

fullyConnectedLayer(64,"Name","fc")

fullyConnectedLayer(2,"Name","fc_2")

softmaxLayer("Name","softmax")

classificationLayer("Name","classification");

];

lgraph = addLayers(lgraph,tempLayers);

lgraph = connectLayers(lgraph,"dropout","concat/in1");

lgraph = connectLayers(lgraph,"fc_1","concat/in2");

% Clear temporary variables

clear tempLayers;

% Display the network structure

plot(lgraph)

% Training options

options = trainingOptions("sgdm", ...

MaxEpochs=15, ...

InitialLearnRate=0.01, ...

Plots="training-progress", ...

Verbose=0);

% Train the network using the combined training dataset

net = trainNetwork(trainDs,lgraph,options);

Error using trainNetwork (line 191)
Unable to apply function specified by 'MiniBatchFcn' value.

Caused by:
Error using minibatchqueue (line 188)
Unable to apply function specified by 'MiniBatchFcn' value.
Error using padsequences (line 134)
Input sequences must be numeric or categorical arrays.

it seems that I have the wrong input format, so how can I solve this bug? Thanks for your viewing my question and I'm glad to receive any guidance from you!

2 个评论
显示无隐藏无

Saurabh 2024-10-30

Hi @辰铭,

While reviewing the documentation for 'minibatchqueue', I discovered the definition of 'miniBatchFcn', which is a property of 'minibatchqueue'. It states that:

'Use a function handle to a custom function to preprocess mini-batches for custom training. Doing so is recommended for one-hot encoding classification labels, padding sequence data, calculating average images, and so on. You must specify a custom function if your data consists of cell arrays containing arrays of different sizes.'

From what I understand, there is a need to specify a custom function because the data consists of cell arrays of varying sizes.

The same information can be found here:

https://www.mathworks.com/help/deeplearning/ref/minibatchqueue.html#mw_aaf9fc69-ade9-4de0-80ec-77c1e73eb00c

I hope this was helpful.

辰铭 2024-11-3

Thanks a lot. Indeed it seems that I need to customize a function to convert my data from Datastore format to sequence input format, I'll give it a try!

请先登录，再进行评论。

请先登录，再回答此问题。

error using trainNetwork and minibatchqueue, on a multi-inputs (sequence and feature) network

2 个评论
显示无隐藏无

回答（0 个）

另请参阅

类别

标签

产品

版本

Community Treasure Hunt

error using trainNetwork and minibatchqueue, on a multi-inputs (sequence and feature) network

2 个评论 显示 无隐藏 无

回答（0 个）

另请参阅

类别

标签

产品

版本

Community Treasure Hunt

2 个评论
显示无隐藏无