GPU vs. CPU in training time

Question

Ali Al-Saegh 2020-12-5

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/680293-gpu-vs-cpu-in-training-time

回答： Joss Knight 2020-12-11

I am doing deep learning on a CNN composed of four convolutional-max-pooling layers with about 100 kernels at each convolutional layer. I am using .mat files that each contain a matrix of size 22x1000 as the training data. An image datastore has been created as a container of the training data where I use a special ReadFun to read those .mat files.

GPU: GTX 1660 super

CPU: i7-9700

MATLAB version: R2019b

hard drive: SSD nvme m.2

Mini-batch size: 400

The training time of one epoch on the GPU is just half that of the CPU! I believe that the training time on GPU must be much less than on CPU only which is not the case with me. Any suggestions to handle that?

May raw data is EEG signals. Each EEG trial composed of 22x1000, where 22 is the number of time signals and 1000 is the number of time points in each signal. Any suggestions to store the data in a different way or creating a different datastore to achieve better GPU utilization?

3 个评论
显示 1更早的评论隐藏 1更早的评论

Ali Al-Saegh 2020-12-7

Awesome! This really reduced the training time on the GPU. Now the speedup is enhanced.

Now I am using imageInputLayer[22 1000 1] as the input layer of my CNN, is this correct for my case?

Joss Knight 2020-12-11

If the 22 time signals are different channels of each observation then your input data should be 1000-by-1-by-22 for a temporal convolutional network using 2-D convolution.

请先登录，再进行评论。

请先登录，再回答此问题。