Action value exceeds the boundry of the final layer activation fucntion of the actor

2 次查看（过去 30 天）

显示更早的评论

awcii 2023-6-17

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1984659-action-value-exceeds-the-boundry-of-the-final-layer-activation-fucntion-of-the-actor

评论： awcii 2023-6-19

在 MATLAB Online 中打开

Hi,

I'm using DDPG agent for my RL application with Matlab 2022a version.

I want to take action between 0 and 1 value. To do this, i use SigmoidLayer function at the final layer of the action. However, it exceed the 0-1 boundry. I also tried to use tanh with

scalingLayer(Scale=0.5,Bias=0.5);

,but it exceed the boundry again. How it can be possible?

Meanwhile, i also tried to use

actInfo = rlNumericSpec([1 1],LowerLimit=0,UpperLimit=1);

to limit action, yes it limits the action value but it doesn't scale it. it just act as a saturation block (like putting a saturation block in simulink in front of the action output). So, with this way, the RL works wrong.

How can achive to take action between 0 and 1?