datastoreToRDD
Class: matlab.compiler.mlspark.SparkContext
Namespace: matlab.compiler.mlspark
Convert MATLAB datastore
to a Spark RDD
Syntax
rdd = datastoreToRDD(sc,ds)
Input Arguments
sc
— SparkContext to use
SparkContext
object
The SparkContext to use, specified as a SparkContext
object.
ds
— Datastore to be converted
MATLAB datastore
Datastore to be converted to an RDD, specified as a MATLAB datastore
object.
Output Arguments
rdd
— Output RDD
RDD
object
Output RDD representing the converted datastore
object,
returned as a RDD
object.
Examples
Convert MATLAB Datastore to Spark RDD
Convert a MATLAB datastore
object
to a Spark RDD.
% Setup Spark Properties as a MATLAB Map object using a containers.Map class sparkProp = containers.Map({'spark.executor.cores'}, {'1'}); % Create SparkConf object conf = matlab.compiler.mlspark.SparkConf(... 'AppName' , 'myApp', ... 'Master' , 'local[1]', ... 'SparkProperties', sparkProp ); % Create a SparkContext sc = matlab.compiler.mlspark.SparkContext(conf); % Create a MATLAB datastore ds = datastore('airlinesmall.csv','TreatAsMissing','NA'); % Convert MATLAB datastore to Spark RDD rdd = datastoreToRDD(sc,ds); % Alternate object usage: rdd = sc.datastoreToRDD(ds);
Version History
Introduced in R2016b
MATLAB 命令
您点击的链接对应于以下 MATLAB 命令:
请在 MATLAB 命令行窗口中直接输入以执行命令。Web 浏览器不支持 MATLAB 命令。
Select a Web Site
Choose a web site to get translated content where available and see local events and offers. Based on your location, we recommend that you select: .
You can also select a web site from the following list:
How to Get Best Site Performance
Select the China site (in Chinese or English) for best site performance. Other MathWorks country sites are not optimized for visits from your location.
Americas
- América Latina (Español)
- Canada (English)
- United States (English)
Europe
- Belgium (English)
- Denmark (English)
- Deutschland (Deutsch)
- España (Español)
- Finland (English)
- France (Français)
- Ireland (English)
- Italia (Italiano)
- Luxembourg (English)
- Netherlands (English)
- Norway (English)
- Österreich (Deutsch)
- Portugal (English)
- Sweden (English)
- Switzerland
- United Kingdom (English)