N dimensional multiplication on gpu arrays

Question

ahmet keles 2022-12-7

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1873092-n-dimensional-multiplication-on-gpu-arrays

评论： Joss Knight 2022-12-17

Is there a better way to compute N dimensional multiplication faster on gpu arrays? I am trying to write a custom deep learning layer which works with gpu array data. However this calculation takes too long for the layer to be meaningfull. Is there a way to do element wise multiplication like this one better on gpu arrays?

A=gpuArray(rand(20,20,16,1000));

B=gpuArray(rand(16,1000));

Z=zeros(size(A),'like',A);

tic

for i=1:16

for j=1:1000

Z(:,:,i,j)=A(:,:,i,j).*B(i,j);

end

toc

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

ahmet keles 2022-12-7

在 MATLAB Online 中打开

I have found a clever way to do it. Convert the small matrix into N dimensional array and multiply.

A=gpuArray(rand(20,20,16,10));
B=gpuArray(rand(16,10));
C=Matrisize(B,A);
Z=A.*C;
function [C]=Matrisize(X1,X2)
S=size(X2);
C=zeros(size(X2),'like',X2);
for i=1:S(1)
    for j=1:S(2)
        C(i,j,:,:)=X1;
    end
end
end

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

C B 2022-12-7

2
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1873092-n-dimensional-multiplication-on-gpu-arrays#answer_1122342

在 MATLAB Online 中打开

It is possible to improve the performance of the code you have provided by using the built-in element-wise multiplication operator .* in MATLAB, instead of the loop you are currently using. This operator can automatically take advantage of the parallel processing capabilities of the GPU, allowing for faster computation.

Here is an example of how you can use .* to perform element-wise multiplication of the A and B arrays on the GPU:

% Create gpuArray arrays
A = gpuArray(rand(20,20,16,1000));
B = gpuArray(rand(16,1000));
% Perform element-wise multiplication using .*
Z = A .* B;

Using this approach, the multiplication operation will be performed in parallel on the GPU, which should provide a significant performance improvement compared to using a loop.

Alternatively, you can use the built-in times function to perform element-wise multiplication on the GPU. This function has the same effect as the .* operator, but is written as a function rather than an operator. Here is an example of how to use times to perform element-wise multiplication on the GPU:

% Create gpuArray arrays
A = gpuArray(rand(20,20,16,1000));
B = gpuArray(rand(16,1000));
% Perform element-wise multiplication using times
Z = times(A, B);

Both of these approaches should provide significant performance improvements compared to using a loop to perform element-wise multiplication on the GPU.