Reinforcement Learning - SAC with hybrid action spaces

Question

Federico Toso 2023-10-10

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2031459-reinforcement-learning-sac-with-hybrid-action-spaces

回答： Emmanouil Tzorakoleftherakis 2023-10-11

Current implementation of Soft Actor Critic algorithm (SAC) in Matlab only applies to problems with continuous action spaces.

I must tackle a problem with hybrid action spaces (some actions are continuous, some are discrete).

I know that SAC implementations with hybrid action spaces have been proposed in literature. Is it possible to adjust standard Matlab implementations in order to account for hybrid actions?

If this is not possible, is there any other Reinforcement Learning Algorithm in Matlab that can (and should) be used in order to deal with hybrid action spaces?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Emmanouil Tzorakoleftherakis 2023-10-11

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2031459-reinforcement-learning-sac-with-hybrid-action-spaces#answer_1330999

Hi,

Unfortunately, hybrid action spaces are not currently supported out of the box. One potential workaround is to use multi-agent training and train one agent for the discrete portion of the action space, and another for the continous part.

It would be helpful to know some more details about the application as well as some links to the papers you mentioned. I could use this information to discuss with the development team.

Thanks