Hadoop job fails with unable to find DCS

2 次查看（过去 30 天）

显示更早的评论

Cameron Taggart 2016-6-1

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/286730-hadoop-job-fails-with-unable-to-find-dcs

关闭： MATLAB Answer Bot 2021-8-20

在 MATLAB Online 中打开

I am trying to get this to work: http://www.mathworks.com/help/distcomp/run-mapreduce-on-a-hadoop-cluster.html

Here is the error:

>> cluster.HadoopProperties('ClusterMatlabRoot') = '/usr/local/MATLAB/R2016a/toolbox/distcomp';
>> meanDelay = mapreduce(ds,@meanArrivalDelayMapper,@meanArrivalDelayReducer,mr,'OutputFolder',outputFolder)
Parallel mapreduce execution on the Hadoop cluster:
********************************
*      MAPREDUCE PROGRESS      *
********************************
Map   0% Reduce   0%
Error using mapreduce (line 101)
The HADOOP job failed to complete.
Caused by:
    The HADOOP job was not able to find a correct installation of MATLAB
    Distributed Computing Server for attempt 1 of 'MAP' task 0. Ensure that the
    'ClusterMatlabRoot' property on the mapreducer cluster object is set to the
    MATLAB Distributed Computing Server installation on the cluster.

I've installed MDCS on the master node and both worker nodes. Am I setting the wrong property? Am I setting it to the wrong value? What do I need to do to get past this error?

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Jeevan Joishi 2016-6-7

编辑：Jeevan Joishi 2016-6-7

Hi Cameron,

Can you also include the following details in your question -

1. The version of MATLAB and MATLAB Distributed Computing Server(MDCS). I believe MATLAB and MDCS are tied to specific release as of now.

2. Did you validate MDCS setup? Are you able to ping the server from the client and vice-versa? Information on how to manually validate MDCS or with specific schedulers are given in Link1, Link2, Link3

Additional information can be found in this document.

If the issue still persists, I suggest you contact MathWorks Technical Support.

此问题已关闭。