How to implement reinforcement learning in Dspace using code generation

Question

0 个投票

I have trained a nonlinear model using Reinforcement learning via MATLAB 2022b and now I want to implement the reinforcement learning block in dSPACE using code generation, while the simulink will pop out the error "Code generation does not support importing handle classes from matlab".What should I do to fix this error? Thank you very much. Any suggestions are appreciated.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Follow Question

Answer 1

Milan Bansal 2023-9-7

0 个投票

Hi,

As per my understanding you are facing an error when implementing Reinforcement Learning (RL) Agent block using code generation.

The Reinforcement Learning Agent block does not support code generation for training. A workaround for this issue is to use Simulink Blocks such as MATLAB function Block or "Predict" block from Deep Learning Toolbox in place of RL Agent Block, which will allow using pre-trained networks including RL Policies in Simulink and supports code generation.

Refer to the MATLAB Answer link below which resolves a similar issue.

https://www.mathworks.com/matlabcentral/answers/757154-how-to-implement-reinforcement-learning-using-code-generation?s_tid=answers_rc1-2_p2_MLT 

However, if the error is due to code generation for MATALB handle class, it is required to have a function that invokes the class.

Refer to the example in the documentation link given below.

https://www.mathworks.com/help/simulink/ug/generate-code-for-matlab-handle-classes-and-system-objects.html 