You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2025/09/17 06:26:00 UTC

[jira] [Created] (SPARK-53608) Improve Grouped Python UDF

Ruifeng Zheng created SPARK-53608:
-------------------------------------

             Summary: Improve Grouped Python UDF
                 Key: SPARK-53608
                 URL: https://issues.apache.org/jira/browse/SPARK-53608
             Project: Spark
          Issue Type: Umbrella
          Components: Connect, PySpark, SQL
    Affects Versions: 4.1.0
            Reporter: Ruifeng Zheng


1, optimize the data exchange in Grouped UDFs, e.g. apply batching to avoid OOM;

2, introduce new iterator API to process the data within a group;



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org