why Nvidia A100 GPUs slower than RTX 3090 GPUs?

Question

재호 곽 2022-5-13

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1718315-why-nvidia-a100-gpus-slower-than-rtx-3090-gpus

评论： Joss Knight 2022-5-16

Hello, we have RTX3090 GPU and A100 GPU.

Using the Matlab Deep Learning Toolbox Model for ResNet-50 Network, we found that the A100 was 20% slower than the RTX 3090 when learning from the ResNet50 model.

The questions are as follows.

1. I heard that the speed of A100 and 3090 is different because there is a difference between the number of CUDA cores and the number of Tensor cores, so can only use Cuda cores for Matlab?

If you can use it, I would appreciate it if you could send me a link if you have an example site using Tensor core.

2. You can specify single inference, double inference, and half inference methods when learning GPU. I heard that Matlab uses double inference automatically, so please check if it is the correct answer.

Thank you.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

David Willingham 2022-5-13

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1718315-why-nvidia-a100-gpus-slower-than-rtx-3090-gpus#answer_963390

See this answer for an explanation:

https://www.mathworks.com/matlabcentral/answers/1711380-rtx-3090-vs-a100-in-deep-learning?s_tid=ta_ans_results

2 个评论
显示无隐藏无

재호 곽 2022-5-16

编辑：재호 곽 2022-5-16

Thank you for your answer. However, I have already checked the URL you sent me. Currently, I have used GPU cord, and I am conducting training, not an inference. I wonder that A100 is slower than 3090 in the training process. I wonder if double precision is available in the training process in Matlab.

Joss Knight 2022-5-16

It is possible to train models in double precision, using model functions, or using a dlnetwork and converting its weights to double precision before training.

However, I don't believe this is what you want. You won't get a speedup over the RTX 3090 training in single precision, it will still be considerably slower.

请先登录，再进行评论。