How to prefetch data during network training ?

Question

Xie Shipley 2023-11-23

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2051332-how-to-prefetch-data-during-network-training

编辑： Venu 2023-11-25

Is there any method to prefetch data during network training In MATLAB?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Venu 2023-11-25

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2051332-how-to-prefetch-data-during-network-training#answer_1359547

Hi @Xie Shipley,

Yes you can prefetch your data while training the network in MATLAB if you have a GPU. While the GPU is working on the current mini-batch of data, the CPU can simultaneously prepare the next mini-batch, which helps reduce the time the GPU spends waiting for data.

To implement data prefetching in MATLAB, you can use the "backgroundDispatchEnable" property of the "miniBatchQueue" object. This property enables the loading and processing of data in the background while the GPU is training on the current batch.

You can refer to these documentations:

https://www.mathworks.com/help/deeplearning/ref/minibatchqueue.html

https://www.mathworks.com/help/deeplearning/ug/datastores-for-deep-learning.html#mw_4e35721b-f50a-412a-af91-c35e606f52cc

hope this helps

2 个评论
显示无隐藏无

Xie Shipley 2023-11-25

Yes, i have GPU.

I use `trainNetwork` with custom-mini-batch-datastore, and enbale `DispatchInBackground` in trainingOptions. But the Parallel Pool will not start automatically, Are there any steps I'm missing ?@Venu

Venu 2023-11-25