Which is the difference between 'multi-gpu' and 'parallel-gpu' in 'trainingOption' function of the DeepLearning Toolbox?

Question

Enzo Losi 2024-5-22

1
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2121511-which-is-the-difference-between-multi-gpu-and-parallel-gpu-in-trainingoption-function-of-the-d

回答： Joss Knight 2024-6-14

Hi everyone,

I have two NVIDIA RTX 3060 installed on my local computer and I want to train a neural network in parallel on both GPUs. I am worried about which is the best strategy between 'multi-gpu' and 'parallel-gpu'. Does anyone know how they work and which is the difference between 'multi-gpu' and 'parallel-gpu'?

Thank you.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Matt J 2024-5-22

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2121511-which-is-the-difference-between-multi-gpu-and-parallel-gpu-in-trainingoption-function-of-the-d#answer_1461921

编辑：Matt J 2024-5-22

According to the doc, 'parallel-gpu' has the additional capability of being able to use remote GPUs. Since that doesn't apply to the hardware environment you describe, you can probably use either one.

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Enzo Losi 2024-5-22

Thank you very much for the quick response!

请先登录，再进行评论。

Answer 2

Joss Knight 2024-6-14

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2121511-which-is-the-difference-between-multi-gpu-and-parallel-gpu-in-trainingoption-function-of-the-d#answer_1472221

The purpose of 'multi-gpu' is effectively to try to ensure you are using a local pool with numGpus workers, rather than needing to understand anything about configuring a cluster. So either can work, but multi-gpu will give you helpful errors if you're doing something you didn't intend.