How to put vector as a element in rlNumericSpec?

2 次查看（过去 30 天）
Yang Chen
Yang Chen 2023-3-1
评论： Yang Chen 2023-3-3
Hi, Everyone,
I am trying to create custom MATLAB Environment from template. My observations consist of numerical variable and vector, like
observation = [number, number, vector, vector]
Unfortunately, I find rlNumericSpec only support number as element. I want to know how to deal with this situation.

请先登录，再回答此问题。

采纳的回答

Emmanouil Tzorakoleftherakis
You could do something along the lines of:
ObservationInfo(1) = rlNumericSpec([1 1]);
ObservationInfo(1).Name = 'scalar';
ObservationInfo(2) = rlNumericSpec([3 1]);
ObservationInfo(2).Name = 'vector';
and then use the obsInfo to create your environment
  5 个评论
显示 3更早的评论
Emmanouil Tzorakoleftherakis
Emmanouil Tzorakoleftherakis 2023-3-3
Not sure how much I can add without knowing specifics, but assuming your environment is in MATLAB (i.e. not Simulink), when you step through your dynamics you will basically get observations that differ in length. In that function, I would assign each observation to a specific slot. So, for example, obs(1) is position, obs(2) is velocity, obs(3) is acceleration. If in certain situations you don't have, e.g. velocity measurements, then set obs(2)=0 and the other two values would be equal to your measurements. If you don't have acceleration, obs(3)=0 and so on

请先登录，再进行评论。

更多回答（0 个）

类别

在 Help Center 和 File Exchange 中查找有关 Reinforcement Learning 的更多信息

标签

产品


版本

R2022a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by