You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Fangchen Li (Jira)" <ji...@apache.org> on 2026/01/03 22:17:00 UTC

[jira] [Created] (SPARK-54891) Unified type coercion for Arrow-backed Python UDFs

Fangchen Li created SPARK-54891:
-----------------------------------

             Summary: Unified type coercion for Arrow-backed Python UDFs
                 Key: SPARK-54891
                 URL: https://issues.apache.org/jira/browse/SPARK-54891
             Project: Spark
          Issue Type: Sub-task
          Components: PySpark
    Affects Versions: 4.2.0
            Reporter: Fangchen Li


When Arrow optimization is enabled for Python UDFs, the type coercion behavior differs from that of the pickle-based UDFs.

We need to control the coercion behavior for backward compatibility and to help migrations.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org