[jira] [Assigned] (SPARK-60357) Return a named record from read_single_udf for every eval type

["Yicong Huang (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-60357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yicong Huang reassigned SPARK-60357:
------------------------------------

    Assignee: Yicong Huang

> Return a named record from read_single_udf for every eval type
> --------------------------------------------------------------
>
>                 Key: SPARK-60357
>                 URL: https://issues.apache.org/jira/browse/SPARK-60357
>             Project: Spark
>          Issue Type: Sub-task
>          Components: PySpark
>    Affects Versions: 5.0.0
>            Reporter: Yicong Huang
>            Assignee: Yicong Huang
>            Priority: Major
>              Labels: pull-request-available
>
> read_single_udf ends with an if/elif chain over eval types that packs each UDF into one of several positional tuple shapes, padded with None placeholders, for the handler that consumes it. Since each tuple is only a private contract between read_single_udf and one handler, read_single_udf should instead return a single named record (and read_single_udtf a UDTF record) for every eval type, and each EvalTypeHandler should take the fields it needs by name, deriving per-handler values such as num_udf_args or the kwargs/toInternal wrapping in its own __init__.



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org