You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2026/07/24 18:40:00 UTC

[jira] [Updated] (SPARK-58314) Remove ArrowStreamUDFSerializer

     [ https://issues.apache.org/jira/browse/SPARK-58314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated SPARK-58314:
-----------------------------------
    Labels: pull-request-available  (was: )

> Remove ArrowStreamUDFSerializer
> -------------------------------
>
>                 Key: SPARK-58314
>                 URL: https://issues.apache.org/jira/browse/SPARK-58314
>             Project: Spark
>          Issue Type: Sub-task
>          Components: PySpark
>    Affects Versions: 5.0.0
>            Reporter: Yicong Huang
>            Priority: Major
>              Labels: pull-request-available
>
> After all eval types that used ArrowStreamUDFSerializer (including the mapInArrow paths, grouped/cogrouped-map Arrow UDFs, UDTF paths, and TransformWithStateInPySparkRowSerializer) have been refactored to build their serializers directly in worker.py, the ArrowStreamUDFSerializer class is dead code with no runtime users. Remove the class and update the stale docstring references in conversion.py that mention it.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org