R2023a Cloudera Hadoop error com.mathwo​rks.toolbo​x.parallel​.hadoop.Ma​tlabStartu​pFailureEx​ception: parallel:m​apreduce:H​adoopTaskO​therFailur​e

20 次查看(过去 30 天)
On MATLAB R2023a MATLAB Distributed Computing Server (MDCS) running on Cloudera Hadoop we periodically get the below error in a mapreduce job failure but then it will run fine. Any ideas?
2024-04-26 16:04:35,721 ERROR [IPC Server handler 24 on 34933] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1690115930864_20721693_r_000000_0 - exited : com.mathworks.toolbox.parallel.hadoop.MatlabStartupFailureException: parallel:mapreduce:HadoopTaskOtherFailure
Caused by: com.mathworks.util.ShutdownRuntimeException: Java is shutting down
at com.mathworks.mvm.MvmFactory.nativeStartSession(Native Method)
at com.mathworks.mvm.MvmSession.createSession(MvmSession.java:276)
at com.mathworks.mvm.MvmSession.createSession(MvmSession.java:249)
at com.mathworks.toolbox.parallel.hadoop.worker.MvmPool.initializeMvmSession(Unknown Source)
at com.mathworks.toolbox.parallel.hadoop.worker.MvmPool.<init>(Unknown Source)
at com.mathworks.toolbox.parallel.hadoop.link.MatlabWorkerSingleton.initialize(Unknown Source)
at com.mathworks.toolbox.parallel.hadoop.link.MatlabReducer.setup(Unknown Source)
at com.mathworks.toolbox.parallel.hadoop.link.MatlabReducer.run(Unknown Source)
at com.mathworks.toolbox.parallel.hadoop.MatlabReflectionReducer.run(Unknown Source)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:628)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:390)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1898)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)

回答(0 个)

类别

Help CenterFile Exchange 中查找有关 Startup and Shutdown 的更多信息

产品


版本

R2023a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by