Tensor Cores and deep learning

Question

Gerardo Suarez 2019-6-24

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/468516-tensor-cores-and-deep-learning

评论： Alexander Sonin 2021-12-3

Dear all

I have a GeForce RTX 2060. How can I take advantage of its 240 tensor cores for deep learning? I have read that I should set the precision to FP16, but using the "trainnetwork" function there does not seem to be any option.

Thank you

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Carpenter86 2019-9-5

Great question! I have the same one. Did you find any answer?

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Krishna Bindumadhavan 2019-9-14

2
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/468516-tensor-cores-and-deep-learning#answer_391857

编辑：Krishna Bindumadhavan 2019-9-14

Currently, there is no support for training a neural network with half precision data type. This is expected in a future release.

You can however take advantage of tensor cores, while generating code for deploying a trained neural network with GPU Coder. You can look at Deep Learning Prediction with NVIDIA TensorRT example , but set the DataType property of the DeepLearningConfig to 'fp16'. This will use the Tensor cores on a Volta or Turing card such as the RTX series for inference.

In addition, MATLAB supports the half data type via the half precision object in the fixed point designer toolbox: https://www.mathworks.com/help/fixedpoint/ref/half.html?s_tid=doc_ta . General code generation support for the half type, via MATLAB Coder and GPU coder is under active development and can be expected in an upcoming release.