rlNumericSpec and rlFiniteSetSpec multi channell environment + Qtable

5 次查看（过去 30 天）
Jpk
Jpk 2022-1-19
回答： Aditya 2024-1-16
I'm seeking to develop a custom environment for a (partially observable) Q learning problem. In particular I'm interested in been able to use in my environment a DT markov chain and some differential equations ( which estimante the state of the Markov chain). Something like have observations which are rlNumericSpec and rlFiniteSetSpec. In other words I would need my observations to have multiple channels and make use of a Qtable
Is there some best practice/ideas on how to accomplish this?
Cheers

请先登录，再回答此问题。

回答（1 个）

Aditya
Aditya 2024-1-16
Developing a custom environment for a partially observable Q-learning problem with a discrete-time (DT) Markov chain and differential equations is a complex task. However, MATLAB provides the tools necessary to create such an environment. Here are some best practices and ideas to help you accomplish this:
  1. Define the Environment interface
  2. Create the Custom Environment
  3. Create the Q-Table
  4. Implement the Learning Algorithm
  5. Create the MATLAB Environment Object

类别

在 Help Center 和 File Exchange 中查找有关 Environments 的更多信息

标签

产品


版本

R2020b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by