BackProgation Neural network on GPU

2 次查看（过去 30 天）

显示更早的评论

Tiki Tiki 2018-8-3

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/413365-backprogation-neural-network-on-gpu

重新打开： Walter Roberson 2018-12-22

采纳的回答： Diwakar Ravichandran

Hi everyone,

Can you help me how to write backprogation in neural network on GPU?

I assume that my data is big, and number of input, hidden, output neuron are 784, 1024 and 10. this like MNIST data.

I write code manually, not use function in neural network tools.

I wonder about update weight is not parallel, so How can use GPU here?

Thanks so much.

2 个评论
显示无隐藏无

Joss Knight 2018-8-3

Nobody is going to be able to answer your question in its current form. It's impossible to tell what help you need. If you don't know how to use the GPU in MATLAB, then read the documentation on that. If you don't know how to write the equations for backpropagation then you should be specific about what operation you want to backpropagate through. To get help, you need to be specific, and you need to provide some example code.

Tiki Tiki 2018-8-6

Thank. I wrote backprogation code not use function 'train' support by matlab. So my mean is in the backprogation, we have to update weight based on previous weight. so I dont know how to use parallel programming here. is it mean we put 60000 samples of MNIST once time. and then caculate error?. please correct me if i am wrong? Thank.

请先登录，再进行评论。

请先登录，再回答此问题。

采纳的回答

Diwakar Ravichandran 2018-8-8

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/413365-backprogation-neural-network-on-gpu#answer_331976

Hi Tiki,

As I try to understand you want to implement back propagation by hard coding the variables. To do the same you have to know the back propagation algorithm and understand how it works. You cant code on a GPU you code and the process runs on a GPU.

This article online explains what back propagation is as mentioned below,

https://mattmazur.com/2015/03/17/a-step-by-step-backpropagation-example/

Hope this helps,

Cheers!

7 个评论
显示 5更早的评论隐藏 5更早的评论

Diwakar Ravichandran 2018-8-8

https://www.mathworks.com/discovery/matlab-gpu.html

I think this should help

Tiki Tiki 2018-8-8

Thank. I already run code use function with GPU supported by matlab like train or feedforward. however, I cannot see inside function, So I had to write step by step to describe backprogation in my network. but i still dont understand how GPU can use.

Anyway, Thank for your support.

请先登录，再进行评论。