Speed up 'dlgradient' with parallelism?

Question

Evan Scope Crafts 2021-4-11

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/799152-speed-up-dlgradient-with-parallelism

评论： Luis Hernandez 2023-11-14

Hi all,

I am wondering if there is a way to speed up the 'dlgradient' function evaluation using parallelism or GPUs.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Jon Cherrie 2021-4-12

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/799152-speed-up-dlgradient-with-parallelism#answer_673002

You can use a GPU for the dlgradient computation by using a gpuArray with dlarray.

In this example, the minibtachqueue, puts data on to the GPU and thus the GPU is used for the rest of the computation, both the "forward" pass the "backward" (gradient) pass:

https://www.mathworks.com/help/deeplearning/ug/train-network-using-custom-training-loop.html?#TrainNetworkUsingCustomTrainingLoopExample-5

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Luis Hernandez 2023-11-14

Hello.

I've been trying to use the functions 'dlgradient' and 'dlfeval' with gpuArray inputs so that matlab will use my GPU. Unofrtunately, they only work when I pass dlarray inputs.

What is the workaround for this? what is the minibatch doing that allows you to work with gpuArray?

Thanks!

-L

请先登录，再进行评论。