Cuda with Turing GPU and NeuralNetworkToolbox in 2017b

4 次查看（过去 30 天）

GW 2018-10-26

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/426316-cuda-with-turing-gpu-and-neuralnetworktoolbox-in-2017b

评论： M J 2020-12-7

Im running Matlab 2017b with update 9 and I wanted to train a convolutional neural net using trainNetwork(...) together with a Nvidia Turing GPU (RTX 2070, Driver version 416.34). However, there is an error message showing up after quite a bit of delay:

Training on single GPU.
Initializing image normalization.
|=======================================================================================================================|
|     Epoch    |   Iteration  | Time Elapsed |  Mini-batch  |  Validation  |  Mini-batch  |  Validation  | Base Learning|
|              |              |  (seconds)   |     Loss     |     Loss     |     RMSE     |     RMSE     |     Rate     |
|=======================================================================================================================|
Error using trainNetwork (line 140)
Unexpected error calling cuDNN: *CUDNN_STATUS_EXECUTION_FAILED.*
Error in NetTrainTest (line 67)
net = trainNetwork(inputConv,outputConv,layers,options);
Caused by:
    Error using nnet.internal.cnngpu.convolveForward2D
    Unexpected error calling cuDNN: CUDNN_STATUS_EXECUTION_FAILED._

When I train the network using the CPU, everything is fine. I also do not get any errors when I use normal calculus with GPU arrays, everything works fine.

The output of gpuDevice is as follows:

                      Name: 'GeForce RTX 2070'
                       Index: 1
           ComputeCapability: '7.5'
              SupportsDouble: 1
               DriverVersion: 10
              ToolkitVersion: 8
          MaxThreadsPerBlock: 1024
            MaxShmemPerBlock: 49152
          MaxThreadBlockSize: [1024 1024 64]
                 MaxGridSize: [2.1475e+09 65535 65535]
                   SIMDWidth: 32
                 TotalMemory: 8.5899e+09
             AvailableMemory: 7.6195e+09
         MultiprocessorCount: 36
                ClockRateKHz: 1620000
                 ComputeMode: 'Default'
        GPUOverlapsTransfers: 1
      KernelExecutionTimeout: 1
            CanMapHostMemory: 1
             DeviceSupported: 1
              DeviceSelected: 1

Any ideas on what causes this issue? Thank you for your reply.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

采纳的回答

Joss Knight 2018-10-26

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/426316-cuda-with-turing-gpu-and-neuralnetworktoolbox-in-2017b#answer_343671

This is a bit distressing, to discover this. However, if the option is available to you, you should upgrade MATLAB to 18a or 18b. 17b does not natively support Turing and there may be issues.

24 个评论
显示 22更早的评论隐藏 22更早的评论

Patrick Kiefer 2019-1-29

在 MATLAB Online 中打开

Hello, same problem here by using

[net, info] = trainNetwork(pximds,lgraph,options);

Error:

Unexpected error calling cuDNN: CUDNN_STATUS_EXECUTION_FAILED.

Matlab: R2018b (Update 2) / GPU: RTX 2070 aswell / CUDA Toolkit 10.0

  CUDADevice with properties:
                      Name: 'GeForce RTX 2070'
                     Index: 1
         ComputeCapability: '7.5'
            SupportsDouble: 1
             DriverVersion: 10
            ToolkitVersion: 9.1000
        MaxThreadsPerBlock: 1024
          MaxShmemPerBlock: 49152
        MaxThreadBlockSize: [1024 1024 64]
               MaxGridSize: [2.1475e+09 65535 65535]
                 SIMDWidth: 32
               TotalMemory: 8.5899e+09
           AvailableMemory: 6.8846e+09
       MultiprocessorCount: 36
              ClockRateKHz: 1635000
               ComputeMode: 'Default'
      GPUOverlapsTransfers: 1
    KernelExecutionTimeout: 1
          CanMapHostMemory: 1
           DeviceSupported: 1
            DeviceSelected: 1