You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Li Jin (JIRA)" <ji...@apache.org> on 2018/10/04 14:42:00 UTC

[jira] [Created] (SPARK-25640) Clarify/Improve EvalType for grouped aggregate and window aggregate

Li Jin created SPARK-25640:
------------------------------

             Summary: Clarify/Improve EvalType for grouped aggregate and window aggregate
                 Key: SPARK-25640
                 URL: https://issues.apache.org/jira/browse/SPARK-25640
             Project: Spark
          Issue Type: Sub-task
          Components: PySpark
    Affects Versions: 2.4.0
            Reporter: Li Jin


Currently, grouped aggregate and window aggregate uses different EvalType, however, they map to the same user facing type PandasUDFType.GROUPED_MAP.

It makes sense to have one user facing type because it (PandasUDFType.GROUPED_MAP) can be used in both groupby and window operation.

However, the mismatching between PandasUDFType and EvalType can be confusing to developers. We should clarify and/or improve this.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org