predict fucntion in deep learning toolbox does not use gpu

Question

yongbo chen 2021-7-27

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/886684-predict-fucntion-in-deep-learning-toolbox-does-not-use-gpu

回答： Joss Knight 2021-8-14

I use a pre-trained network from tensorflow 2.0 to predict a depth image from an RGB image. The code is：

    dlX = dlarray(double(I)./255,'SSCB');
    dlY = predict(dlnet,dlX);

The code works fine, but it is very slow. I find that it seems that the code only use the cpu core instead of gpu.

From the online help document, I find the following explanation:

It seems that the default way to run predict is to use a gpu. I find my gpu seems to be avaliable in MATLAB by running the gpu test function like:

gpuDevice;

A = gpuArray([1 0 1; -1 -2 0; 0 1 -1]);
 e = eig(A);

It works fine with my gpu:

Name: 'GeForce RTX 2060'

Index: 1

ComputeCapability: '7.5'

SupportsDouble: 1

DriverVersion: 11.2000

ToolkitVersion: 11

MaxThreadsPerBlock: 1024

MaxShmemPerBlock: 49152

MaxThreadBlockSize: [1024 1024 64]

MaxGridSize: [2.1475e+09 65535 65535]

SIMDWidth: 32

TotalMemory: 6.4425e+09

AvailableMemory: 4.9872e+09

MultiprocessorCount: 30

ClockRateKHz: 1200000

ComputeMode: 'Default'

GPUOverlapsTransfers: 1

KernelExecutionTimeout: 1

CanMapHostMemory: 1

DeviceSupported: 1

DeviceAvailable: 1

DeviceSelected: 1

Any way to deal with this problem? Thank you very much.

2 个评论
显示无隐藏无

KSSV 2021-7-27

编辑：KSSV 2021-7-27

在 MATLAB Online 中打开

You can try:

I = gpuArray(I) ;     
dlX = dlarray(I./255,'SSCB');
dlY = predict(dlnet,dlX);

Not sure, but it might throw some errors. Also note that the weights needs to be taken to gpu, not sure whether it works completely on GPU or not.

yongbo chen 2021-7-27

Thank you for your answer. Do you know how to take the weights to gpu in MATLAB. Any function?

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Joss Knight 2021-8-14

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/886684-predict-fucntion-in-deep-learning-toolbox-does-not-use-gpu#answer_767067

That is the documentation for DAGNetwork, not dlnetwork. dlnetwork does not have an ExecutionEnvironment, it chooses its environment in the same way that other GPU operations do, by reacting to the incoming data. As KSSV points out, converting to a gpuArray is the correct solution in this case.

For details see dlnetwork/predict Extended Capabilities.