Use GPU for the matlab code

1 次查看（过去 30 天）

Virtualkeeda 2021-7-8

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/874673-use-gpu-for-the-matlab-code

评论： Virtualkeeda 2021-7-10

I have computations on structs in my code with a label identifier and other numerical values. What I could understand is I can use gpuArray only for numerical computations but whenever it encounter a logical operation, it doesnt work. Is there a way out of this problem?

I am trying to run code available at: https://in.mathworks.com/matlabcentral/fileexchange/42853-deep-neural-network

Can anyone please help?

10 个评论
显示 8更早的评论隐藏 8更早的评论

Virtualkeeda 2021-7-8

编辑：Virtualkeeda 2021-7-8

在 MATLAB Online 中打开

So, here is the whole structure of the struct:

bbdn (consists of a type and a struct named rbm)

2. bbdbn.rbm (consists of 3 inner struct)

3. bbdbn.rbm{1,1}: consists of a type and 3 internal matrics W,b, & c (i have used gpuArray so they are showing like that now)

The opertaions are performing on these W,b, and c. You were right, earlier I was passing the whole struct to gpuArray, which was wrong and hence I was getitng the error. Now, I used gpuArray on the matrix operations such as:

dbn.rbm{nrbm}.W = gpuArray(linearMapping( Hall{nrbm-1}, OUT ));
H = gpuArray(sigmoid( bsxfun(@plus, V * dnn.W, dnn.b ) ));

There were many such operations.

But still the code is running as same as previous. Also, after using gpuArray I can see 0% GPU utilization. Am I missing something to install for matlab or for the gpu? Here is my gpuDevice details:

Name: 'Quadro T2000'

Index: 1

ComputeCapability: '7.5'

SupportsDouble: 1

DriverVersion: 11

ToolkitVersion: 10.1000

MaxThreadsPerBlock: 1024

MaxShmemPerBlock: 49152

MaxThreadBlockSize: [1024 1024 64]

MaxGridSize: [2.1475e+09 65535 65535]

SIMDWidth: 32

TotalMemory: 4.2950e+09

AvailableMemory: 3.1927e+09

MultiprocessorCount: 16

ClockRateKHz: 1785000

ComputeMode: 'Default'

GPUOverlapsTransfers: 1

KernelExecutionTimeout: 1

CanMapHostMemory: 1

DeviceSupported: 1

DeviceSelected: 1

@Joss Knight @Walter Roberson.. Any help or suggestion is appreciated.

Joss Knight 2021-7-9

在 MATLAB Online 中打开

Isn't your input data in variables like dnn.b, dnn.W, Hall{i} and others? Plus all you seem to have done in the above is to move one set of network parameters to the GPU, rather than all of them. Isn't rbm a struct array containing many variables, all of which need to be gpuArray objects?

It's probably best to start with the documentation: https://www.mathworks.com/help/parallel-computing/run-matlab-functions-on-a-gpu.html

The basic principle is that if the data at the input to a function is a gpuArray object, that function will run on the GPU. Use the MATLAB debugger to check the datatype of the data about to be used on each line of your code, and make sure it is a gpuArray. You can use the isgpuarray() function.

You should also make sure your data is declared as single precision, so for instance replace

gpuArray(randn(dimV, dimH) * 0.1);

with

randn(dimV, dimH, 'single', 'gpuArray') * 0.1;

Note how I also create the data directly on the GPU rather than on the CPU and then moving it, as well as performing the scalar multiply on the GPU rather than the host.

Virtualkeeda 2021-7-9

Yes, the actual input data is in dnn.W,dnn.b etc.

Also, yes rbm is an struct containing a struct and a identifier type with labels like 'DNN', 'BBDBN' etc... But I think I cannot pass this rbm struct to gpuArray.

I guess, I will again have to go through the documentation on gpuArray.

Virtualkeeda 2021-7-10