This is a known issue with cuDNN. Following are some workarounds,
1. Update to newer release of MATLAB. Newer releases might use newer versions of cuDNN that fix the issue.
2. Update cuDNN library. The steps are mentioned below.
3. Decrease mini batch size. The issue occurs due to large mini batch size.
Please follow the steps below to update the cuDNN library:
1. Download an appropriate version of cuDNN for your CUDA toolkit version and OS from https://developer.nvidia.com/cudnn.
a. You can see your CUDA toolkit version from the output of the "gpuDevice" command.
b. Here is a link for more info about installing the CUDA driver and toolkit: https://www.mathworks.com/help/parallel-computing/gpu-support-by-release.html
2. Unzip the downloaded file
3. Close MATLAB
4. Replace the existing library files in the following locations with the new one.
a. Notes:
i. You can get your MATLAB path by running the 'matlabroot' command in MATLAB.
ii. Before making the replacements, you should make a copy of the old files in case anything breaks.
b. For Windows:
i. Replace <yourmatlabpath>\matlab\sys\cuda\win64\cudnn\include\cudnn.h with <yourdownloadpath>\cuda\include\cudnn.h
ii. Replace <yourmatlabpath>\matlab\sys\cuda\win64\cudnn\lib\x64\cudnn.lib with <yourdownloadpath>\cuda\lib\x64\cudnn.lib
iii. Replace <yourmatlabpath>\matlab\bin\win64\cudnn64_7.dll with <yourdownloadpath>\cuda\bin\cudnn64_7.dll
c. For Linux:
i. Replace <yourmatlabpath>/matlab/sys/cuda/glnxa64/cudnn/include/cudnn.h with <yourdownloadpath>/cuda/include/cudnn.h
ii. Replace <yourmatlabpath>/matlab/bin/glnxa64/libcudnn.so with <yourdownloadpath>/cuda/lib64/libcudnn.so
iii. Replace <yourmatlabpath>/matlab/bin/glnxa64/libcudnn.so.7 with <yourdownloadpath>/cuda/lib64/libcudnn.so.7
iv. Replace <yourmatlabpath>/matlab/bin/glnxa64/libcudnn.so.7.5.0 with <yourdownloadpath>/cuda/lib64/libcudnn.so.7.6.x
5. Start MATLAB and verify that your script runs
