Big Data Processing

You can use Parallel Computing Toolbox™ to distribute large arrays in parallel across multiple MATLAB^® workers, so that you can run big-data applications that use the combined memory of your cluster. You operate on the entire array as a single entity, however, workers operate only on their part of the array, and automatically transfer data between themselves when necessary. Parallel Computing Toolbox also enables you to execute MATLAB tall array and datastore calculations in parallel, so that you can analyze big data sets that do not fit in the memory of your cluster. You can use MATLAB Parallel Server™ to run tall array and datastore calculations in parallel on Spark enabled Hadoop clusters. Doing so significantly reduces the execution time of very large data calculations.