Cannot use database cursor object inside a parfor

Question

Tommaso Guseo 2018-4-10

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/393937-cannot-use-database-cursor-object-inside-a-parfor

编辑： TIANTIANBABA 2021-1-17

If I retrieve data from an sql query using the database interface of matlab database toolbox inside a parfor like this:

 parfor i = 1:n
   [...]
   cursorObj1 = fetch(exec(targetConn,sqlQueryString));
   queryData = cursorObj1.Data{1};
   [...]
 end

Matlab throws the error:

Cell contents reference from a non-cell array object.

Is there a way to accomplish the aforementioned operation inside a parfor? I know the basic rules of variables and objects use inside a parfor, but I can't find a solution for this specific case.

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

TIANTIANBABA 2021-1-17

Did you find an solution yet?

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Edric Ellis 2018-4-17

2
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/393937-cannot-use-database-cursor-object-inside-a-parfor#answer_315545

You need to create the database connection targetConn directly on the workers. One way to achieve this is to use a parallel.pool.Constant to hold on to it. Something a bit like this:

connection = parallel.pool.Constant(@() database(...), @close);
parfor ...
  ...
  cursorObj1 = fetch(exec(connection.Value, ...));
  ...
end

Note that the second argument to the parallel.pool.Constant constructor is the "cleanup" function - this will close the underlying connection when connection goes out of scope.

3 个评论
显示 1更早的评论隐藏 1更早的评论

AJ Geiger 2018-5-19

Not that I know :/ of if you want to debug a parfor loop I have found the best way to do it is to convert the parfor loop to just a for loop.

TIANTIANBABA 2021-1-17

编辑：TIANTIANBABA 2021-1-17

Hello. Even if I build the connection inside the parfor-loop, it seems that exec and fetch still can not work when inside the parfor-loop.

Here is my needs:

I have many sqlite files, and I need to export data from every sqlite file. I want to use parfor-loop to speed up, and inside the loop, I want each worker to connect to a different file, then do the data export work. But until now I don't succeed.

请先登录，再进行评论。