[jira] [Commented] (SPARK-8641) Native Spark Window Functions

["Herman van Hovell (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-8641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635205#comment-14635205 ] 

Herman van Hovell commented on SPARK-8641:
------------------------------------------

We need to wait for the new UDAF interface to stabilize. Special attention needs to be paid to following aspects:
* Hive UDAFs
* Difference in processing an AlgebraicAggregate, AggregateFunction2 & (potentially) AggregateFunction
* Common aggregate processing functionality.

> Native Spark Window Functions
> -----------------------------
>
>                 Key: SPARK-8641
>                 URL: https://issues.apache.org/jira/browse/SPARK-8641
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 1.5.0
>            Reporter: Herman van Hovell
>
> The current Window implementation uses Hive UDAFs for all aggregation operations. In this ticket we will move to this functionality to Native Spark Expressions. The rationale for this is that although Hive UDAFs are very well written, they remain opaque in processing and memory management; this makes them hard to optimize.
> This ticket and its PR will build on the work being done in SPARK-4366.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org