Model Based Reinforcement Learning

5 次查看(过去 30 天)
I'm trying to implement model based reinforcement learning with matlab. I have a directed graph and i want to travel from origin to destination. Using the function createMDP would be possible to create a very simple graph. The main problem is because the actions are generic. What i would like to do is to allow only a subset of actions depending on the current state. A solution is to implement a good reward function to penalize undesired/invalid actions, but that means a lot more training. So i'd like to speed up the learning by only allowing specific actions depending on the current state. Is it possible to do that?

回答(1 个)

Neuropragmatist
Neuropragmatist 2019-9-10
Your agent shouldn't be able to make 'invalid' actions at all. For undesired actions, as you say the correct reward function with time should lead to the correct learning and this unconstrained approach would certianly be the most convincing.
You can of course restrict the actions of the agent in specific circumstances, but I think you would have to have good reason to implement those and be able to show that you are not just initialising your model with the parameters you expect at the end.
Hope this helps,
NP.
  1 个评论
Jillian Eunice Oliveros
编辑:Jillian Eunice Oliveros 2021-10-26
@Neuropragmatist Using createMDP, Is it possible to add certain conditions (if else) as to what state the agent will have to transition into? For example, when the pixel intensity is more than 10, the transition will be to state 2. And if not, it will transition to state 3.

请先登录,再进行评论。

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by