MATLAB Engine for Python is very slow

Question

serafeim loukas 2021-11-1

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1576885-matlab-engine-for-python-is-very-slow

评论： Alan Frankel 2024-3-12

I have a main python script and I want to call a Matlab function (spm_filter.m) on an array.

I use something like the following in a jupyter notebook:

import matlab.engine
eng = matlab.engine.start_matlab()
y_filtered = np.asarray(eng.spm_filter(filter_kernel, matlab.double(data.tolist()) ,nargout=1))

This works fine but it is extremely slow compared to the case where I use only Matlab to do the same thing e.g. by doing:

y_filtered = spm_filter(filter_kernel, data)

Why is the matlab engine so slow? How can I make it faster?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Alan Frankel 2022-6-8

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1576885-matlab-engine-for-python-is-very-slow#answer_981685

The performance in R2022a is orders of magnitude better than in previous releases, as described in the release notes. See the item "MATLAB Engine API for Python: Improved performance with large multidimensional arrays in Python" under the "Performance" section. As mentioned there, converting a Python array of size 10^8 to a MATLAB double array is about 12x faster than in the previous release, and executing the sum() function (including data conversion between Python and MATLAB) is about 110x faster than in the previous release.

4 个评论
显示 2更早的评论隐藏 2更早的评论

Mitchell Tillman 2024-3-11

编辑：Mitchell Tillman 2024-3-11

@Alan Frankel I was having some performance issues with sending a 30MB variable from Python to MATLAB and so just upgraded from R2021b to R2023b and performance was way worse - there's a memory leak now (RAM useage shot up over 20GB in just a minute or two, which did not happen before) and a function that used to take ~0.2 seconds now took 0.5 - 1.5 seconds to run (this is untenable because I need to run it many times).

Is there any reason to suspect that R2022a performs better than R2023b? Going to downgrade back to R2021b so I can benchmark the two versions.

Edit: the attached images shows memory useage over time running many iterations of the same function I mentioned above, in R2021b and R2023b. I also posted a question expanding on my issue.

Alan Frankel 2024-3-12