Memory leak when interfacing between Matlab and python

9 次查看(过去 30 天)
Hi. I have found a problem when I try to make communication between Matlab and python (using optimisation in matlab). I have built a model in Matlab and tried to use Scipy to optimise the parameters in the model. Therefore, I wrote an objective function in python and use "matlab.engine" to interface between the two. However, I have found that the simulation time in each iteration increases when I call Matlab engine.
With the code below, the simulation time keeps increasing after finishing eacg interation.
eng = matlab.engine.start_matlab()
def opt_pf(x):
y = eng.matlab_model(excel_path, x, nargout=0)
return y
gc.collect()
### Run optimisation
from scipy.optimize import minimize
res = minimize(opt_pf, x0, method='SLSQP', constraints=[eq_cons], options={'ftol': 1e-09, 'disp': True}, bounds=bounds)
I think that the optimizer canno't clear the cache from matlab.engine in each iteration.
  9 个评论
Øyvind
Øyvind 2023-11-24
I have experienced similar issues (Matlab R2023b on Windows).
For me, it seems like the problem is mostly if running in ExecutionMode="OutOfProcess", while "InProcess" is better.
With OutOfProcess execution mode, I see that there is a process called matlabpyhost which ends up using tons of memory (as seen in Task Manager).
So to do this, use something like:
pyenv(ExecutionMode="OutOfProcess")
(Obviously, the InProcess vs OutOfProcess also affects other things, see https://se.mathworks.com/help/matlab/ref/pyenv.html )

请先登录,再进行评论。

回答(3 个)

Donato
Donato 2023-8-16
I am facing the same problem, we really need some support here.

Clark
Clark 2023-12-28
Me too! HUGE leaks... Sometimes swelling to 40 GB, when expecting maybe only 2GB

Neil
Neil 2024-10-9
编辑:Neil 2024-10-9
I encountered the same issue in MATLAB2023b. The attachments in the following old bug report looks helpful, but it is for a much much older version of MATLAB.

类别

Help CenterFile Exchange 中查找有关 Call MATLAB from Python 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by