Deep learning with a GPU that supports fp16

6 次查看（过去 30 天）

显示更早的评论

Sukhwa Hong 2019-8-28

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/477984-deep-learning-with-a-gpu-that-supports-fp16

编辑： Sukhwa Hong 2021-2-24

采纳的回答： Joss Knight

Hi.

NVDIA has released the new RTX 2XXX and 3XXX series that support fp16 that accelrates training process.

Does Matlab support this?

Thank you

4 个评论
显示 2更早的评论隐藏 2更早的评论

Walter Roberson 2019-9-1

An interesting article came through recently, https://www.linkedin.com/pulse/deep-learning-cant-progress-ieee-754-floating-point-heres-omtzigt/

Krishna Bindumadhavan 2019-9-14

There is support for half precision in MATLAB via the half precision object, available in the fixed point designer toolbox:https://www.mathworks.com/help/fixedpoint/ref/half.html.

General Code generation support for half precision data type via MATLAB Coder and GPU Coder is under active development. This functionality is expected in an upcoming release.

As mentioned below, there is no support currently for using half for training a deep learning network in MATLAB. This is expected in a future release.

请先登录，再进行评论。

请先登录，再回答此问题。

采纳的回答

Joss Knight 2019-8-29

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/477984-deep-learning-with-a-gpu-that-supports-fp16#answer_389691

You can take advantage of FP16 when generating code for prediction on a deep neural network. Follow the pattern of the Deep Learning Prediction with NVIDIA TensorRT example but set the DataType property of the DeepLearningConfig to 'fp16'. This will use the Tensor cores on a Volta or Turing card such as the RTX series.

There is no way yet to use half precision or Tensor cores for training a deep neural network in MATLAB. This is expected in an upcoming release.

4 个评论
显示 2更早的评论隐藏 2更早的评论

Juuso Korhonen 2021-2-24

What about now? Or do we have to wait for 2021 release?

Joss Knight 2021-2-24

You can use the Deep Network Quantizer to calibrate a trained network for 8-bit reduced precision types. For now, fp16 is not supported, and quantization-aware training is not supported.

With an Ampere card, using the latest R2021a release of MATLAB (soon to be released), you will be able to take advantage of the Tensor cores using single precision because of the new TF32 datatype that cuDNN leverages when performing convolutions on an Ampere card.

请先登录，再进行评论。