GPU Training RL Toolbox on R2022a

29 次查看（过去 30 天）
Berk Agin
Berk Agin 2022-3-28
回答： Valerio 2024-7-26
Hello everyone,
I am trying to train my agent with using Reinforcement Learning Toolbox Matlab2022a. Unfortunately, I couldn't run the training due to some packages were updated. rlRepresentationOptions was contain 'UseDevice','gpu' option, but the package has been changed to rlOptimizerOptions without any 'UseDevice' option. How can I run my training with using gpu? Thank you in advance.
  3 个评论
显示 1更早的评论
Berk Agin
Berk Agin 2022-3-31
Hi Kaustubh,
Thank you for your answer. I'll be looking forward to the solution. Have a nice day.

请先登录，再进行评论。

请先登录，再回答此问题。

回答（2 个）

Aashita Dutta
Aashita Dutta 2022-3-31
Hello Berk,
According to my understanding, you are trying to train agent using Reinforcement Learning Toolbox MATLAB 2022a. Due to package upgrades, rlRepresentationOptions is not recommended, instead rlOptimizerOptions is used to train agent.
Could you please try the following workaround to train using GPU:
criticOptions = rlOptimizerOptions('LearnRate',1e-03,'GradientThreshold',1);
criticOptions.UseDevice = 'gpu';
Please follow the instructions given in this documentation- How to training agent using GPU example to get more information.
  4 个评论
显示 2更早的评论
Abolfazl Nejatian
Abolfazl Nejatian 2022-7-27
but as i check there is no property 'UseDevice' for the rlOptimizerOptions!
could you please help me on this matter.
Bradley Fourie
Bradley Fourie 2022-8-17
编辑：Bradley Fourie 2022-8-17
Hi everyone,
I would like to add my 2 cents since the Matlab R2022a reinforcement learning toolbox documentation is a complete mess.
I think I have figured it out:
  • Step 1: figure out if you have a supported GPU with
availableGPUs = gpuDeviceCount("available")
gpuDevice(1)
  • Step 2: When creating your actor and critic use the following to select the GPU (yours might differ but the UseDevice is what is important here)
actor = rlDiscreteCategoricalActor(actorNetWork,oinfo,ainfo,'UseDevice','gpu');
critic = rlValueFunction(criticNetwork,oinfo,'UseDevice','gpu');
  • Step 3: Create your optimizer as usual
actorOpts = rlOptimizerOptions('LearnRate',3e-4,'GradientThreshold',1);
criticOpts = rlOptimizerOptions('LearnRate',3e-4,'GradientThreshold',1);
From what I can gather (with my last two braincells), the function call to use a GPU has moved to the newer actor and critic constructors. However, some staff guidance would be HIGHLY appreciated.

请先登录，再进行评论。

Valerio
Valerio 2024-7-26
Hi guys, I solved in this way:
% define the agent
myagent = rlPPOAgent(obsInfo, actInfo, initopts, agent_opt);
% try to change it into gpu
myactor = getActor(myagent);
mycritic = getCritic(myagent);
myactor.UseDevice = 'gpu';
mycritic.UseDevice = 'gpu';
in this way I could use the rlOptimizerOptions function.
hoping this might be useful, have a good day.

类别

在 Help Center 和 File Exchange 中查找有关 Deep Learning Toolbox 的更多信息

标签

产品


版本

R2022a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by