Why for loop in CPU faster than in GPU

5 次查看（过去 30 天）

显示更早的评论

Khieu 2017-6-21

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/345626-why-for-loop-in-cpu-faster-than-in-gpu

回答： Joss Knight 2017-6-22

在 MATLAB Online 中打开

I am running the following command:

p = zeros(7000000,1); g_p = gpuArray(p);

1. CPU version

for i=1:size(p,1)
p(i) = 10; % just simple to see
end

2. GPU version

for i=1:size(g_p,1)
g_p(i) = 10; % just simple to see
end

It is amazing that the execution time in CPU really more faster than it in GPU. Why?

4 个评论
显示 2更早的评论隐藏 2更早的评论

Khieu 2017-6-21

Thanks Adam

Adam 2017-6-21

It is very difficult often to determine where this crossover is. I have occasionally dabbled with a GPU implementation of some computation in my code, but it is always hit and miss whether it is faster or slower on a particular run since data sizes vary so I often just end up commenting it out with a vague idea I might come back to it one day and consider some fancy code to chose the CPU or GPU version of my code based on input size and any other appropriate metrics, but I never have done so far.

请先登录，再进行评论。

请先登录，再回答此问题。

回答（1 个）

Joss Knight 2017-6-22

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/345626-why-for-loop-in-cpu-faster-than-in-gpu#answer_271520

This isn't amazing at all. You are launching 7 million kernels, each to copy one value into GPU memory. The kernels cannot overlap because they are operating on the same data, which means each must wait for the last to finish. This is not at all an efficient way to do parallel programming!