Reading HDFS from Matlab - what toolboxes do I need?

Question

Anna Dunblad 2017-9-8

1
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/355719-reading-hdfs-from-matlab-what-toolboxes-do-i-need

回答： Chad Greene 2017-9-11

We're planning to implement Hadoop at my work, and I need a way to retreive the data from the Hadoop clusters in the data lake and get it into Matlab. What toolboxes do I need for this? Note that I'm only reading the data from HDFS-files.

Additionally, would I need other toolboxes to be able to read data?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Brandon Eidson 2017-9-11

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/355719-reading-hdfs-from-matlab-what-toolboxes-do-i-need#answer_281130

Hadoop Sequence Files can be read directly in base MATLAB.

https://www.mathworks.com/help/matlab/import_export/read-and-analyze-data-in-keyvaluedatastore-for-sequence-file.html

If you want to do "mapreduce" on a Hadoop cluster, then you need to have licenses for the Parallel Computer Toolbox and MATLAB Distributed Computer Server. Documentation on how to Configure a Hadoop cluster and run "mapreduce" on it is linked to below.

https://www.mathworks.com/help/mdce/configure-a-hadoop-cluster.html

https://www.mathworks.com/help/distcomp/run-mapreduce-on-a-hadoop-cluster.html