How to Convert Entity Attribute Buses into Signal for RL Agent Observation Input?

3 次查看(过去 30 天)
Dear Matlab Simulink Experts,
I am having troubles with my model, right now I have designed a model to emulate a single part that goes through operations and maintenance procedures. I am utilizing bus elements in an entity generator, the next step of my model is to connect the intended output of the model from entity server 'damage' to an observation input port of the RL agent block. The RL agent block will then produce an output through the action port, connected again to an option of entity servers. How do I convert and entity attribute into a signal that the RL agent can receive, and vice versa, how do I revert back the signal into an entity attribute, after the RL agent has made its decision? Or what are other options other than converting entities to signal?
The attempts I have made were using a signal conversion block, and a Matlab function block, but my efforts hasn't been rewarding so far.
Your help would be very much appreciated. Attached are my files:
  • ModelV1.slx (the simulink model)
  • BusProfile.mat (the bus elements containing the entity attribute)
  • initialize.m (to initialize the bus editor)
  • RLScriptV4.mlx (the Reinforcement Learning script)
And this is the error generated:
Thank you in advance.

采纳的回答

Laurent Royer
Laurent Royer 2024-7-18
Hi Aaron,
To convert an entity attribute into a signal, you can use a Simulink function. For example, to get the D attribute as a signal:
Add a Simulink Function "getD" as below:
This Simulink Function simply contains:
And you call it from your server complete action, see the last command below:
  7 个评论
Laurent Royer
Laurent Royer 2024-7-24
I think there's an algebraic loop that you should break. Try inserting a Memory block just before the Simulink function getAction.
Aaron Bramhasta
Aaron Bramhasta 2024-7-29
Hi Laurent,
Thank you for your reply, your solution worked!
The RL Agent was able to implement the actions onto the SimEvents blocks, although the results are not what I expected as I would get from a dry model (with SimEvents only and without RL), but I will find out why the results differ.
Once again, thank you for your time, consideration, and expertise, it is very much appreciated.
Best,
Aaron.

请先登录,再进行评论。

更多回答(0 个)

类别

Help CenterFile Exchange 中查找有关 Discrete-Event Simulation 的更多信息

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by