why does (ga + parallel + global variables + sub2ind) fail?

2016 9 9
3 个回答
回答已采纳
更新时间：2016 9 12
7 次查看（30 天）

0 个投票

When optimizing with ga and parallel computing, a sub2ind call using globals fails (subscript vectors must be of same size), but when doing it in serial, it doesn't fail. Why?

请先登录，再回答此问题。

 采纳的回答

Matt J
Matt J 2016-9-9

1 个投票

Probably because of the dangers of using global variables.

5 个评论
显示 3更早的评论 隐藏 3更早的评论

Jochen Schuettler
Jochen Schuettler 2016-9-10
编辑：Jochen Schuettler 2016-9-10
Hi Matt, of course I know all about this. There is a bunch of constant data for the fitness function to know. It would really slow down optimization if I unnecessarily copy all that data again and again as a function input. Could you please give a more helpful answer?
Stephen23
Stephen23 2016-9-10
编辑：Stephen23 2016-9-10
"It would really slow down optimization if I unnecessarily copy all that data again and again as a function input"
Not so much... MATLAB only copies variables in the memory when they are changed: "MATLAB internally optimizes for some cases and passes by reference and only creates local copies if modifications are being made to these arguments." source:
https://www.mathworks.com/matlabcentral/answers/96960-does-matlab-pass-parameters-using-call-by-value-or-call-by-reference
So as long as those variables are not being changed you can use them as inputs to a million function calls, and yet there will be no copies in MATLAB's memory.
Walter Roberson
Walter Roberson 2016-9-11
Note that the above discussion is only for serial computing. The considerations are a bit different for parallel computing, where each worker must have a copy of the data because they are different processes.
Matt J
Matt J 2016-9-11
编辑：Matt J 2016-9-11
The discussion still applies to parallel computing if we're not talking about the one-time cost of broadcasting constant data to the workers. The OP seems to think that arguments passed to the fitness function will be copied "again and again" each time the fitness function is called. That is not true, even on parallel workers

请先登录，再进行评论。

更多回答（2 个）

Walter Roberson
Walter Roberson 2016-9-10

1 个投票

Global variables are never copied to parallel workers.
You might be able to take advantage of parallel.pool.Constant or of parfevalOnAll() to initialize the variable on all of the workers.

1 个评论
显示 -1更早的评论 隐藏 -1更早的评论

Walter Roberson
Walter Roberson 2016-9-11
If you have especially large shared data, you could also use the File Exchange contribution https://www.mathworks.com/matlabcentral/fileexchange/28572-sharedmatrix to use shared memory. This will only work if the compute nodes are on the same host, though

请先登录，再进行评论。

类别

在 帮助中心 和 File Exchange 中查找有关 Parallel Computing Toolbox 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by