[jira] [Resolved] (SPARK-34421) Custom functions can't be used in temporary views with CTEs

["Wenchen Fan (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-34421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wenchen Fan resolved SPARK-34421.
---------------------------------
    Resolution: Fixed

> Custom functions can't be used in temporary views with CTEs
> -----------------------------------------------------------
>
>                 Key: SPARK-34421
>                 URL: https://issues.apache.org/jira/browse/SPARK-34421
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 3.1.0
>         Environment: Databricks Runtime 8.0
>            Reporter: Lauri Koobas
>            Assignee: Peter Toth
>            Priority: Blocker
>             Fix For: 3.0.3, 3.1.1
>
>
> The following query works in Spark 3.0 not Spark 3.1.
>   
>  Start with:
>  {{spark.udf.registerJavaFunction("custom_func", "com.stuff.path.custom_func", LongType())}}
>   
>  Works: * {{select custom_func()}}
>  * {{create temporary view blaah as select custom_func()}}
>  * {{with step_1 as ( select custom_func() ) select * from step_1}}
> Broken:
>  {{create temporary view blaah as with step_1 as ( select custom_func() ) select * from step_1}}
>   
>  followed by:
>  {{select * from blaah}}
>   
>  Error:
>  {{Error in SQL statement: AnalysisException: No handler for UDF/UDAF/UDTF '}}{{com.stuff.path.custom_func}}{{';}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org