MDCS - how is data handled?

1 次查看(过去 30 天)
Lachlan Simpson
Lachlan Simpson 2015-7-3
Within an MDCS system, is the data sent across the network and only sits in the memory of the head/workers, or is there a requirement for data storage?

回答(2 个)

Harsha Medikonda
Harsha Medikonda 2015-7-6
Based on my understanding you wish to know the data storage requirements for clusters. Please refer to the following link for the requirements of data storage Requirements for data storage on cluster computers
To transfer data between workers, you can use 'addAttachedFiles'. When files are attached using this command, they are shared across all the workers. Currently there is a 2 GB limit for the data transfer across workers. Refer to the following link for more information on 'addAttachedFiles'

Lachlan Simpson
Lachlan Simpson 2015-7-8
Thanks for your reply Harsa.
I was wondering if I could get some clarification. When the documentation says:
A shared file system between user desktops and cluster is strongly
recommended. Availability of a shared file system is assumed by default
for all the built-in configurations. An API is available to extend these
configurations for environments with nonshared file systems.
I am unclear what this means.
Is the suggestion that:
  • the entire filesystem should be shared (!)
  • /home
  • some sort of scratch space - /mnt/DATA or somesuch
  • /usr/local/MATLAB/*
  • /usr/local/MATLAB/R20xyz/toolbox/*
Some combination of the above?

类别

Help CenterFile Exchange 中查找有关 MATLAB Parallel Server 的更多信息

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by