You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Tomasz Gawęda (JIRA)" <ji...@apache.org> on 2018/09/04 17:10:00 UTC

[jira] [Created] (SPARK-25334) Default SessionCatalog doesn't support UDFs

Tomasz Gawęda created SPARK-25334:
-------------------------------------

             Summary: Default SessionCatalog doesn't support UDFs
                 Key: SPARK-25334
                 URL: https://issues.apache.org/jira/browse/SPARK-25334
             Project: Spark
          Issue Type: Task
          Components: SQL
    Affects Versions: 2.3.1
            Reporter: Tomasz Gawęda


SessionCatalog calls registerFunction to add a function to function registry. However, makeFunctionExpression supports only UserDefinedAggregateFunction.

We should make makeFunctionExpression support UserDefinedFunction, as it's one of functions type.

Currently we can use persistent functions only with Hive metastore, but "create function" command works also with default SessionCatalog. It sometimes cause user confusion, like in https://stackoverflow.com/questions/52164488/spark-hive-udf-no-handler-for-udaf-analysis-exception/52170519



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org