Can compiled CTF files be retrieved from HDFS?

2 次查看（过去 30 天）

Cameron Taggart 2016-5-20

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/285074-can-compiled-ctf-files-be-retrieved-from-hdfs

评论： Nikhil Sreekumar 2016-8-11

Following the instructions to run on Hadoop, I've got the basic airlinesmall sample running. I was able to use `hdfs:///` paths for the input file `hdfs:///airlinsmall.csv` and output folder `hdfs:///airlinesmall-output`. However, I had to put the `ctf` file on the filesystem of the master VM. I really want to be able to use `hdfs:///airlinesmall.ctf` as the location for the input file instead of `/home/cameron/airlinesmall.ctf`. Am I doing something wrong? If it is not supported, could this be added?

I'm using R2015b (Runtime v90). <file:///usr/local/MATLAB/MATLAB_Runtime/v90/toolbox/mlhadoop/jar/a2.2.0/mwmapreduce.jar> com.mathworks.hadoop.MWMapReduceDriver

It if funny that the first lines from the output show it being uploaded to HDFS. Couldn't that be skipped and set the HDFSCTFPATH directly?

java.library.path: /usr/lib/hadoop/lib/native
HDFSCTFPath=hdfs://cluster-for-cameron-m:8020/user/root/airlinesmall/airlinesmall.ctf
Uploading CTF into distributed cache completed.

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Nikhil Sreekumar 2016-8-11

In hadoop, usually in deployable mode, the jar file is deployed after compiling. In MATLAB, ctf files are analogous to jar files, hence they are loaded into the distributed cache. If you find any link mentioning copying of the executable to the hdfs, could you share?

请先登录，再进行评论。

请先登录，再回答此问题。