Build Simulink Real-Time Applications in Parallel

Question

James 2021-2-17

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/748512-build-simulink-real-time-applications-in-parallel

评论： James 2022-12-30

I have a large number of simulink real-time applications that I am trying to build to run on a Speedgoat system. I would like to decrease the build time by running the builds in parallel. It takes 30 minutes to build one application and there are 600+ applications so you can see that building them serially is not a good solution. The models are not dependent on eachother and they are not referenced so the standard built in functionality for parallel model reference bulids with slbuild will not work. The models use data from the base workspace (parameters, configuration reference, bus objects, etc.). I have tried to create a parfor loop detailed below where I save the workspace to a mat file and then load it on each worker before I run slbuild, but I receive the following error.

Error using parallelBuild (line 8)
Unable to find configuration: 'Model_CnfgRef' referenced by 'TC225'.

This configuration exists in the base workspace which I am loading on to each worker. Any thoughts on what I am doing wrong?

Code:

    parfor i=1:length(buildCandidates)
        l = load('workspace.mat');
        evalin('base',['slbuild(TC',num2str(buildCandidates(i)),')']);
    end

Also tried this:

    parfor i=1:length(bulidCandidates)
        l = load('workspace.mat');
        slbuild(['TC',num2str(buildCandidates(i))]);
    end

2 个评论
显示无隐藏无

Brian Iwatake 2021-2-17

Sorry, this is a lame answer, but I would contact the Speedgoat people directly. They may have some tips.

James 2021-2-17

Thanks for the suggestion. I could reach out to them, but I feel this is really an issue on the MathWorks side because it is building the Simulink Real-Time application. The Speedgoat group generally focuses on the hardware part of the setup.

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Raymond Norris 2021-2-17

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/748512-build-simulink-real-time-applications-in-parallel#answer_626232

在 MATLAB Online 中打开

I'm not a Simulink expert, so I'm assuming that loading the workspace (which is the same for all?) will introduce, for example, Model_CnfgRef? If so, try this.

...
parfor i=1:length(bulidCandidates)
    build_model(bulidCandidates,i)
end
...
function build_model(bulidCandidates,i)
    l = load('workspace.mat');
    slbuild(['TC',num2str(bulidCandidates(i))]);
end

9 个评论
显示 7更早的评论隐藏 7更早的评论

James 2021-2-18

在 MATLAB Online 中打开

Yes you beat me to responding. I added whos and realized my mistake. I don't want the workspace saved in variable l. I added this because of a "transparency" warning not realizing its effect. So I modified the subfunction to how you have it, and verified through "whos" that Model_CnfgRef exists in the workspace.

function build_model(buildCandidates,i)  
    load('workspace.mat');
    whos
    slbuild(['TC' num2str(buildCandidates(i))]);
end

I also tried simplifing the code to just build two models in parallel. As a long shot, I attached both models explicitly even though I believed the models were already accessible by pool the pool workers. It did not change the end outcome. It is obviously not having a problem finding the model file because slbuild is able to open it and know it contains a reference configuration.

poolobj = gcp;
addAttachedFiles(poolobj,{['TC' num2str(buildCandidates(1))] ['TC' num2str(buildCandidates(2))]});
parfor i=1:2
    build_model(buildCandidates,i)
end

So now the parallel worker is:

Accessing the model from the client
Has the same workspace as the client
Has the same path as the client

Why is it still unable to build on the remote worker?

James 2021-2-18

编辑：James 2021-2-18

在 MATLAB Online 中打开

Thanks for the clarification. The files I attached are simulink models, but I don't think I needed to attach them becuase there was no error saying the workers could not access the files. I receive the same error below ether way. Here is the error I receive with the latest code:

Warning: Unable to find configuration set 'Model_CnfgRef' for the active configuration reference 'Reference'
> In load_system (line 21)
  In load_model
  In slbuild (line 95)
  In parallelBuild>build_model (line 19)
  In parallel_function>make_general_channel/channel_general (line 852)
  In remoteParallelFunction (line 46)
Error using slbuild_private
Unable to find configuration: 'Model_CnfgRef' referenced by 'TC225'.
Error in sl (line 15)
[varargout{1:nargout}]=feval(varargin{:});
Error in slbuild (line 98)
   sl('slbuild_private', mdl, target, varargin{2:end});
Error in parallelBuild>build_model (line 19)
    slbuild(['TC' num2str(buildCandidates(i))]);
Error in parallelBuild (line 10)
parfor i=1:2

Here is a snipit of the "whos" output from the first worker that shows Model_CnfgRef exists in the worker's workspace.

    parallelBuild
Warning: Files that have already been attached are being ignored. To see which files are attached see the 'AttachedFiles' property of the parallel pool. 
  Name                                                   Size                Bytes  Class                       Attributes
  ModelVariant                                            1x1                   552  struct                                
  BuildIndices                                           1x34                  272  double                                
  Comms                                                  1x1                 10712  struct                                
  ModelLatencies                                           1x1                  5336  struct                                
  ModelSensorOverrideLimits                                1x1                  1840  struct                                
  Model_CnfgRef                                            1x1                        Simulink.ConfigSet                    
  Model_CnfgRef_HIL                                        1x1                        Simulink.ConfigSet                    

Jon Lobo 2022-12-19

Hi James,

I'm going to reopen this thread if thats ok. I worked on something similar for another customer and have a few tips for how to get this to work.

Use projects if you aren't already.
I highly recommend using data dictionaries as well because relying on base workspace is difficult to debug in parallel workers.
Ultimtaely, the first two bullets are because each worker needs to know everything. It's significantly easier if each worker just needs to open a project.
I recommend using parfeval rather than parfor. parfeval will have your workers work on the builds while enabling you to continue to do things in MATLAB desktop.
Lastly, having each worker build in the same folder is risky as each worker will need access to some common files during code generation and compilation. I find it better to use Simulink.filegencontrol and have each worker do a build in their own directory so they can work in isolation.

Based on the type of problem and your other posts, I'm assuming this is all part of a Simulink Test and Simulink Real-Time workflow.

From the fields in the post, I thikn you are using R2019b. I have an example for using parallel computing toolbox to build all external test harnesses used in a test suite. The code queries the test suite to identfy the models it needs to build, builds the first one in MATLAB desktop and builds the rest using parfeval. The idea is that once the model required by first test is built, you can start running the tests in Simulink test while the other models build.

Please let me know if this is of interest and I can post the example here. Likewise, if you need this in a new release, please let me know and I can update it.

-Jon

James 2022-12-30

Hi Jon,

I appreciate the reply. I would be interested in seeing your example if you have it.

Thanks!

James

请先登录，再进行评论。

Build Simulink Real-Time Applications in Parallel

2 个评论
显示无隐藏无

回答（1 个）

9 个评论
显示 7更早的评论隐藏 7更早的评论

另请参阅

类别

标签

产品

版本

Community Treasure Hunt

Build Simulink Real-Time Applications in Parallel

2 个评论 显示 无隐藏 无

回答（1 个）

9 个评论 显示 7更早的评论隐藏 7更早的评论

另请参阅

类别

标签

产品

版本

Community Treasure Hunt

2 个评论
显示无隐藏无

9 个评论
显示 7更早的评论隐藏 7更早的评论