Out of memory gather()

1 次查看（过去 30 天）

显示更早的评论

Maxim Rozhkov 2021-4-23

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/810815-out-of-memory-gather

回答： neal paze 2021-9-1

采纳的回答： jibrahim

在 MATLAB Online 中打开

I am reading the documentation on this topic Deep Learning Denoise. After this line my computer is not responding.

[targets,predictors] = gather(targets,predictors);

Error: Out of memory.

I change number of dataset in this line to 300 and all works good

adsTrain = audioDatastore(fullfile(dataFolder,'train'),'IncludeSubfolders',true);
reduceDataset = true;
if reduceDataset
    adsTrain = shuffle(adsTrain);
    adsTrain = subset(adsTrain,1:1000); % to 300
end

but sometimes i get this Error.

How can I examine the entire dataset if it is really big (87000 files). Or at least 1000. I read the documentation about gather (), but I still don't understand how to get around this Error.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

采纳的回答

jibrahim 2021-4-23

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/810815-out-of-memory-gather#answer_683230

Hi Maxim,

In many practical situations, your data might not all fit in memory. There is a modified workflow for that case. See, for example:

https://www.mathworks.com/help/signal/ug/train-spoken-digit-recognition-network-using-out-of-memory-features.html?searchHighlight=out%20of%20memory%20features&s_tid=srchtitle

and

https://www.mathworks.com/help/audio/ug/train-spoken-digit-recognition-network-using-out-of-memory-audio-data.html?searchHighlight=out%20of%20memory%20features&s_tid=srchtitle

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Maxim Rozhkov 2021-4-24

jibrahim, thank you

请先登录，再进行评论。

更多回答（1 个）

neal paze 2021-9-1

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/810815-out-of-memory-gather#answer_778319

I also have a problem of gather in this document. Have you solved your problem? Can you share how to modify this line of code?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

类别

Signal Processing Signal Processing Toolbox Measurements and Feature Extraction

在 Help Center 和 File Exchange 中查找有关 Measurements and Feature Extraction 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Translated by