Creating Q-table

2021 3 17
1 个回答
更新时间：2022 4 26
3 次查看（30 天）

0 个投票

I have made my own RL environment where the observation is a vector of 8 elements "for example [1,2,3,4,5,6,7,8]" and the action set has four elements(["up","down","right", "left"]) and I'm trying to apply Q-Learning algorithm. my question is how to create the q-table. I did read about
T = rlTable(obsinfo,actinfo)
but I got stuck without any progress. How can I create the table?

2 个评论
显示 无 隐藏 无

hsu yi cheng
hsu yi cheng 2021-9-3
编辑：hsu yi cheng 2021-9-3
Hi, I'm working on a similar project as yours. May I have your file as a reference ? Thanks
RUBEN HERNANDEZ
RUBEN HERNANDEZ 2022-4-26
Hi, Im' trying to simulate Q-learnig for control inverted pendulum in simulink, but i have problem to create the q-table.
For example, I have three watch signals. How can it be defined as discrete observations with their limits?

请先登录，再进行评论。

请先登录，再回答此问题。

回答（1 个）

0 个投票

Did you take a look at this example? It seems to solve a similar problem.
If you want to use the provided API to create a custom grid world, I would follow this link.
If you are implemeting your own, you want to use rlFiniteSetSpec which is designed for discrete observation. rlNumericSpec is for observations continuous in nature.

4 个评论
显示 2更早的评论 隐藏 2更早的评论

Izzat Brgli
Izzat Brgli 2021-3-18
编辑：Izzat Brgli 2021-3-18
I did but to be honest they are not clear for me, for example :
obsInfo = rlNumericSpec([4 1]);
hier I'm defining that the obs will be a vector 4 rows and one column. But how to define my whole observations set?
If you want to use the provided API to create a custom grid world, I would follow this link.
If you are implemeting your own, you want to use rlFiniteSetSpec which is designed for discrete observation. rlNumericSpec is for observations continuous in nature.
(I updated my answer above)
Izzat Brgli
Izzat Brgli 2021-3-18
编辑：Izzat Brgli 2021-3-18
I did what you have recommended and it worked partially. I have right now a table which has the same row's number as the observation's number and the column's number as the action's number but without header (names for columns and rows) and the question is how can I retrieve the data or store it?
Not sure I understand the question. If you type
yourTablename.Table
you have access to all the table elements and you can use them however you need.

请先登录，再进行评论。

类别

在 帮助中心 和 File Exchange 中查找有关 Sources 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by