Parallelizing MATLAB code using many GPU cores

6 次查看（过去 30 天）

显示更早的评论

Omri Lesser 2018-8-29

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/416692-parallelizing-matlab-code-using-many-gpu-cores

评论： Y.Yang 2020-4-25

采纳的回答： Joss Knight

在 MATLAB Online 中打开

I have a MATLAB script that runs many independent iterations (for loop), of the form

for idx=1:N
  result(idx) = some_procedure(data(idx));
end

I have a NVIDIA graphics card with over 3000 CUDA cores. Is it possible to parallelize the code, such that e.g. each GPU core handles one iteration? I understood that parfor is not the answer here but is there some equivalent?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

采纳的回答

Joss Knight 2018-8-31

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/416692-parallelizing-matlab-code-using-many-gpu-cores#answer_334960

GPU cores do not work like CPU cores. They cannot run independent tasks.

To use the GPU with MATLAB, start with the documentation.

10 个评论
显示 8更早的评论隐藏 8更早的评论

Joss Knight 2020-4-19

I can't say because there's no real explanation here of what you're trying to do inside the loop - what some_procedure is.

The most common mistake for someone new to gpuArray is to assume that MATLAB will parallelize your serial code for you, by putting the body of a for-loop, say, into a kernel that will execute on multiple GPU threads. This is not surprising because that is indeed the way parfor works on CPU cores. But GPUs do not work like that. You need to write highly vectorized code, using techniques such as those documented in MATLAB's documentation. There actually is a way to have MATLAB create a kernel for you, using gpuArray/arrayfun, although this isn't generally necessary.

If data(idx) is, as it appears to be, a scalar, then it does look as though this is your problem and what you need is to read the GPU documentation, learn about vectorization, and try to rework your algorithm so that it no longer contains loops. However, it could be that you know all this, you have vectorized your code, and all that's happening is that you were expecting some_procedure to run faster with gpuArray inputs. In order to diagnose that, we're going to have to see what you're doing in that function.

Joss Knight 2020-4-25

You should look elsewhere for further performance improvements. MATLAB has no half datatype, and sparse only supports 2-D matrices so cannot be used for batch operations, not that it would be useful anyway since sparse only makes sense for large matrices.

Y.Yang 2020-4-25

thanks

请先登录，再进行评论。

类别

Parallel Computing Parallel Computing Toolbox GPU Computing GPU Computing in MATLAB

在 Help Center 和 File Exchange 中查找有关 GPU Computing in MATLAB 的更多信息

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by