[jira] [Assigned] (SPARK-54631) Add profiler support for Arrow Grouped Iter Aggregate UDF

["Hyukjin Kwon (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-54631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon reassigned SPARK-54631:
------------------------------------

    Assignee: Yicong Huang

> Add profiler support for Arrow Grouped Iter Aggregate UDF
> ---------------------------------------------------------
>
>                 Key: SPARK-54631
>                 URL: https://issues.apache.org/jira/browse/SPARK-54631
>             Project: Spark
>          Issue Type: Sub-task
>          Components: PySpark
>    Affects Versions: 4.2.0
>            Reporter: Yicong Huang
>            Assignee: Yicong Huang
>            Priority: Major
>              Labels: pull-request-available
>
> Add profiler support for Arrow Grouped Iter Aggregate UDF ({{SQL_GROUPED_AGG_ARROW_ITER_UDF}}). Previously, this UDF type was not recognized as an iterator-based UDF in the profiler infrastructure, causing profilers to not work correctly. Add {{SQL_GROUPED_AGG_ARROW_ITER_UDF}} to the {{_is_iter_based()}} function in {{worker.py}} and the profiler warning list in {{udf.py}} so that profilers can correctly identify and handle it as an iterator-based UDF, consistent with other iterator-based UDFs like {{SQL_SCALAR_ARROW_ITER_UDF}} and {{SQL_MAP_ARROW_ITER_UDF}}.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org