Emmanouil Tzorakoleftherakis
MathWorks
Followers: 6
Followers: 6 Following: 0
Accept 5 answers given by other contributors
Awarded to Emmanouil Tzorakoleftherakis on 27 Jun 2023
Contribute at least one answer each month for 12 consecutive months
Awarded to Emmanouil Tzorakoleftherakis on 02 Jul 2021
Your submissions were downloaded 10 or more times in a month
Awarded to Emmanouil Tzorakoleftherakis on 01 Apr 2021
Reach 500 reputation points
Awarded to Emmanouil Tzorakoleftherakis on 05 Mar 2021
100 of your answers have been accepted
Awarded to Emmanouil Tzorakoleftherakis on 05 Mar 2021
Have 1 submission connected to GitHub
Awarded to Emmanouil Tzorakoleftherakis on 26 Feb 2021
Publish your first submission
Awarded to Emmanouil Tzorakoleftherakis on 26 Feb 2021
Answer 3 questions that were unanswered for more than 30 days
Awarded to Emmanouil Tzorakoleftherakis on 16 Sep 2019
Provide your first answer ever to someone else's question
Awarded to Emmanouil Tzorakoleftherakis on 08 Jan 2018
Feeds
References to multi-agent reinforcement learning schemes in the reinforcement learning toolbox
The following examples are all on multi-agent reinforcement learning (centralized or decentralized): https://www.mathworks.com/...
5 months 前 | 0
| 已接受
Reinforcement Learning on Simscape
One option is to look at introducing the delay on the observation, not the action. Please take a look at <https://www.mathworks....
6 months 前 | 0
| 已接受
Does MPC without constraints also solves QP problem? How to check QP solver within matlab?
Hi, If you don't have constraints, the toolbox will use the analytical solution to the problem, which you can see here. This ha...
7 months 前 | 0
Reaching observation data and pass them to the learning process
In general, you cannot change the observation/action space definition once they are defined. That said, it seems to me that what...
9 months 前 | 0
| 已接受
How to build a reinforcement learning environment for a DCDC converter?
I would look at this example which starts with a model that has a PID controller and shows how to replace it with an RL Agent.
10 months 前 | 0
| 已接受
PPO minibatch size for parallel training with variable number of steps
No data will be discarded actually. As of R2023b, the 4 experiences that are left in your example form their own minibatch and a...
10 months 前 | 0
Why is my DDPG agent converging to a state where it gets continuous penalization, while having a state it can go with 0 penalization?
My guess is that this happens due to the specifics of the problem. You want to build a controller that generates 'zeroes' when t...
10 months 前 | 0
Reinforcement learning: Step function "AvoidObstaclesUsingReinforcementLearningForMobileRobotsExample" example
This example trains the agent against a Simulink environment, not a MATLAB one. The equivalent of the 'step' function is inside ...
10 months 前 | 0
How can I deploy the trained DRL model in a microprocessor, such as DSP or STM32?
You can follow the steps here to generate code from the trained policy. We also have hardware support for STM32 processors, so i...
10 months 前 | 1
| 已接受
Parallel Training of Multiple RL Agents in same environment
Parallel training is currently not supported for multi-agent reinforcement learning. One thing you could do is train the agents ...
10 months 前 | 0
| 已接受
Augmenting MPC Block with Integral Action
Hello, Let me paste a couple of links here that show how we formulate the underlying QP problem in linear mpc in Model Predicti...
10 months 前 | 0
| 已接受
Does my PI + MPC (feedforward controller) configuration make sense?
Looks like the whole point of using an MPC controller was to provide deltas on the PI output based on the output of the piezo ac...
10 months 前 | 0
how to freeze and reset the weights to initial values of neural network.?
You can accomplish what you asked with something along the lines of: init_model = getModel(getCritic(agent)); new_model_layers...
10 months 前 | 0
Cannot propagate non-bus signal to block because the block has a bus object specified.
Looking at the first screenshot, looks like the output of the grid world block is not a bus, but the observations in your RL Age...
10 months 前 | 0
| 已接受
Constraint to state derivatives with NLMPC
See here for all available constraint options with nlmpc. If the state derivatives you need are part of the state vector, you ca...
11 months 前 | 0
| 已接受
Cannot generate C code from MPC object
Please take a look at the example here that uses 'codegen' command.
11 months 前 | 0
| 已接受
RL Agent learns a constant trajectory instead of actual trajectory
Thanks for adding all the details. The first thing I will say is that the average reward on the Episode Manager is moving in the...
11 months 前 | 0
Tune PI Controller Using Reinforcement Learning
Do you maybe have linearize shadowed somewhere on your path? If not, a reproduction model would be good.
11 months 前 | 0
| 已接受
Training Reinforcement Learning Agents --> Use ResetFcn to delay the agent's behaviour in the environment
You can place the RL Agent block inside a triggered subsystem and set the agent's sample time to -1 (see e.g. here). Then set th...
11 months 前 | 0
| 已接受
How to specify the training algorithm of an agent - Reinforcement Learning
'train' takes an agent object as input, so yes the algorithm will be selected depending on the agent.
11 months 前 | 1
| 已接受
DDPG training converges to the worst results obtained during exploration
I cannot see your training options, but what do you mean by "converges"? The training plot only shows about 1800 episodes. There...
11 months 前 | 1
Not able to use multibel GPUs when training a DDPG agent
Can you share your agent options and the architecture of the actor and critic networks? As mentioned here, "Using GPUs is likely...
11 months 前 | 0
Problem with RL agent block
You can use a delay block for the last observation and set the initial value of the delay in the block dialog. That should resol...
11 months 前 | 1
| 已接受
decaying clip factor or entropy loss weight for PPO
These parameters are fixed and cannot be changed after training begins. One workaround would be to train the agent for a certain...
11 months 前 | 0
| 已接受
How to solve the error "Error using sqpInterface Nonlinear constraint function is undefined at initial point. Fmincon cannot continue." Error occurred when calling NLP solver
The dynamics/state function are turned into constraints internally when creating a NLP for fmincon. You don't provide all the fu...
11 months 前 | 0
| 已接受
How do I Tune Model Predictive Controller (MPC) in the Real Time?
There could be many reasons why you don't see the expected results. First thing I would check is whether the controller can actu...
11 months 前 | 0
| 已接受
How Fast is Simulink Real Time? Is Simulink Real Time Faster than Rasberry Pi?
Hi, First of all, how fast (wall clock time) does the Simulink model run with your current MPC implementation? This would be a ...
12 months 前 | 0
Design an actor critic network for non-image inputs
I may be missing something but why don't you frame your observations as a [4 1] vector? That way it would be consistent with how...
12 months 前 | 0
Pausing reinforcement learning by forcing
The proper way to stop it would be through the Episode Manager (top right of the window). Does this not work for you?
12 months 前 | 0
| 已接受
Why DQN training always fails to converge to the optimal value
What I am seeing here is that the average reward tends to converge to the Q0 profile which is the expected behavior of a converg...
12 months 前 | 0
您也可以从以下列表中选择网站：
美洲
- América Latina (Español)
- Canada (English)
- United States (English)
欧洲
- Belgium (English)
- Denmark (English)
- Deutschland (Deutsch)
- España (Español)
- Finland (English)
- France (Français)
- Ireland (English)
- Italia (Italiano)
- Luxembourg (English)
- Netherlands (English)
- Norway (English)
- Österreich (Deutsch)
- Portugal (English)
- Sweden (English)
- Switzerland
- United Kingdom(English)
亚太
- Australia (English)
- India (English)
- New Zealand (English)
- 中国
- 日本Japanese (日本語)
- 한국Korean (한국어)