You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Lauri Koobas (Jira)" <ji...@apache.org> on 2021/02/11 06:33:00 UTC
[jira] [Created] (SPARK-34421) Custom functions can't be used in
temporary views with CTEs
Lauri Koobas created SPARK-34421:
------------------------------------
Summary: Custom functions can't be used in temporary views with CTEs
Key: SPARK-34421
URL: https://issues.apache.org/jira/browse/SPARK-34421
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.1.0
Environment: Databricks Runtime 8.0
Reporter: Lauri Koobas
Works in DBR 7.4, which is Spark 3.0.1. Breaks in DBR8.0(beta), which is Spark 3.1.
Start with:
{{spark.udf.registerJavaFunction("custom_func", "com.stuff.path.custom_func", LongType())}}
Works: * {{select custom_func()}}
* {{create temporary view blaah as select custom_func()}}
* {{with step_1 as ( select custom_func() ) select * from step_1}}
Broken:
{{create temporary view blaah as with step_1 as ( select custom_func() ) select * from step_1}}
followed by:
{{select * from blaah}}
Error:
{{Error in SQL statement: AnalysisException: No handler for UDF/UDAF/UDTF '}}{{com.stuff.path.custom_func}}{{';}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org