Search Java Code Snippets


  Help us in improving the repository. Add new snippets through 'Submit Code Snippet ' link.





Java - Code Samples

 Sample 1. Code Sample / Example / Snippet of org.apache.spark.ml.feature.StopWordsRemover

  public static void main(String[] args) {

SparkConf conf = new SparkConf().setAppName("JavaStopWordsRemoverExample");

JavaSparkContext jsc = new JavaSparkContext(conf);

SQLContext jsql = new SQLContext(jsc);



StopWordsRemover remover = new StopWordsRemover()

.setInputCol("raw")

.setOutputCol("filtered");



JavaRDD<Row> rdd = jsc.parallelize(Arrays.asList(

RowFactory.create(Arrays.asList("I", "saw", "the", "red", "baloon")),

RowFactory.create(Arrays.asList("Mary", "had", "a", "little", "lamb"))

));



StructType schema = new StructType(new StructField[]{

new StructField(

"raw", DataTypes.createArrayType(DataTypes.StringType), false, Metadata.empty())

});



DataFrame dataset = jsql.createDataFrame(rdd, schema);

remover.transform(dataset).show();

jsc.stop();

}


   Like      Feedback      org.apache.spark.ml.feature.StopWordsRemover



Subscribe to Java News and Posts. Get latest updates and posts on Java from Buggybread.com
Enter your email address:
Delivered by FeedBurner