Can develop MapReduce program by MATLAB run effectively with Hadoop?

1 次查看（过去 30 天）
Mohammad Al Nagdawi
回答： Kojiro Saito 2018-2-11
Hadoop by default support Java, C++, and python. However, I developed an algorithm using Matlab to deal with normal size data, later I decide to scale my algorithm using MapReduce to deal with big data.
I want to continue my work in Matlab, but I don't know if Matlab fully and smoothly supports Hadoop or not, therefore I want to hear advice from experts before it's too late.

请先登录，再回答此问题。

回答（1 个）

Kojiro Saito
Kojiro Saito 2018-2-11
MATLAB does support MapReduce on Hadoop with MATLAB Compiler OR Parallel Computing Toolbox / MATLAB Distributed Computing Server.
(1) MATLAB Compiler
With MATLAB Compiler, you can create compiled MapReduce applications. This is a compiled application, so you can execute it with MATLAB Runtime.
For detail, please see this doc: Compiled MapReduce Applications on Hadoop Clusters
(2) Parallel Computing Toolbox / MATLAB Distributed Computing Server With these parallel products, you can scale up your mapreduce algorithm to Hadoop.
Before executing mapreduce, it's needed to configure mapreducer environment, for example,
setenv('HADOOP_HOME', '/path/to/hadoop_home/');
cluster = parallel.cluster.Hadoop;
mr = mapreducer(cluster);
For detail, please see this doc: Run mapreduce on a Hadoop Cluster

类别

在 Help Center 和 File Exchange 中查找有关 MapReduce 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by