Search Java Code Snippets


  Help us in improving the repository. Add new snippets through 'Submit Code Snippet ' link.





#Java - Code Snippets for '#Org.apache.spark.sql.expressions.UserDefinedAggregateFunction' - 1 code snippet(s) found

 Sample 1. Code Sample / Example / Snippet of org.apache.spark.sql.expressions.UserDefinedAggregateFunction

  public void testUDAF() {

DataFrame df = hc.range(0, 100).unionAll(hc.range(0, 100)).select(col("id").as("value"));

UserDefinedAggregateFunction udaf = new MyDoubleSum();

UserDefinedAggregateFunction registeredUDAF = hc.udf().register("mydoublesum", udaf);

DataFrame aggregatedDF =

df.groupBy()

.agg(

udaf.distinct(col("value")),

udaf.apply(col("value")),

registeredUDAF.apply(col("value")),

callUDF("mydoublesum", col("value")));



List<Row> expectedResult = new ArrayList<>();

expectedResult.add(RowFactory.create(4950.0, 9900.0, 9900.0, 9900.0));

checkAnswer(

aggregatedDF,

expectedResult);

}


   Like      Feedback      org.apache.spark.sql.expressions.UserDefinedAggregateFunction



Subscribe to Java News and Posts. Get latest updates and posts on Java from Buggybread.com
Enter your email address:
Delivered by FeedBurner