How to start, pause, log information, and continue a simscape simulation?

3 次查看（过去 30 天）
Anthony
Anthony 2023-6-6
评论： Anthony 2023-6-20
I am looking to use a simscape model as an environment to conduct reinfrocement learning (RL). The RL agent needs to change the kinematics of a robot once every second. As I see it I have two options
1) run 1 second simulations and then provide the end conditions as intial conditions of a new simulation for 10 cycles giving a 10 second simulation (cons: less ideal for visualization purposes, slow)
2) run a 10 second simulation that i am able to pause every second, log the data, and restart the simulation with new kinematics ready to go (probably faster, easier for visualization and implementation)
I'm finding it difficult to find documentation that shows how to programatically pause a simulation after a condition is met and then continue the simulation after changing some of the varaibles in the model. Any guidance would be greatly appreciated!

请先登录，再回答此问题。

回答（1 个）

Emmanouil Tzorakoleftherakis
If you go for #2, why don't you set it so that you have episodes that are 10 seconds long?
When each episode ends, change the initial conditions as needed for the next episode and so on.
  1 个评论
Anthony
Anthony 2023-6-20
I want to be able to update the actions every timestep without reseting the simulation. I think I didn't communicate my problem effectively. Either way I just found this example:
https://www.mathworks.com/help/reinforcement-learning/ug/quadruped-robot-locomotion-using-ddpg-gent.html?s_tid=srchtitle_quadruped_1
I am working through it now to understand it and I think I see how to fix the problem that I have but it requires a signifcant restructuring and different approach. Thanks for the help!

请先登录，再进行评论。

类别

在 Help Center 和 File Exchange 中查找有关 Troubleshooting 的更多信息

标签

产品


版本

R2022b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by