Scaling layer usage for action output

Yihao Wan

2023 6 9

0 个回答

5 次查看（30 天）

0 个投票

Hello, I am using the tanhlayer as the output activation function for the action network while my action space is [0,10]. In this sense, I am referring to this answer by adding scaling layer.

However, I got saturated action value. I looked into the answer, shouldn't it be

scalingLayer('Scale',(actionInfo.UpperLimit-actionInfo.LowerLimit)/2,'Bias',(actionInfo.UpperLimit+actionInfo.LowerLimit)/2)

Thanks for your help.

Here is the code"

numActions = 2; 
actInfo = rlNumericSpec([numActions 1],'LowerLimit',0,'UpperLimit', 10); 
actorNetwork = [
    featureInputLayer(numObservations,'Normalization','none','Name','State')
    fullyConnectedLayer(32, 'Name','actorFC1')
    reluLayer('Name','relu1')
    fullyConnectedLayer(16, 'Name','actorFC2')
    reluLayer('Name','relu2')
    fullyConnectedLayer(numActions,'Name','Action')
    tanhLayer('Name','tanh3')
    scalingLayer('Scale',actInfo.UpperLimit-actInfo.LowerLimit,'Bias',(actInfo.UpperLimit-actInfo.LowerLimit)/2)
    ];
actordlNet = dlnetwork(actorNetwork);
actor = rlContinuousDeterministicActor(actordlNet,obsInfo,actInfo);