[jira] [Updated] (SPARK-18910) Can't use UDF that jar file in hdfs

["Hong Shen (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hong Shen updated SPARK-18910:
------------------------------
    Summary: Can't use UDF that jar file in hdfs  (was: Can't use UDF that source file in hdfs)

> Can't use UDF that jar file in hdfs
> -----------------------------------
>
>                 Key: SPARK-18910
>                 URL: https://issues.apache.org/jira/browse/SPARK-18910
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.0.2
>            Reporter: Hong Shen
>
> When I create a UDF that jar
> <code>
> spark-sql> create function trans_array as 'com.test.udf.TransArray'  using jar 'hdfs://host1:9000/spark/dev/share/libs/spark-proxy-server-biz-service-impl-1.0.0.jar';
> spark-sql> describe function trans_array;
> Function: test_db.trans_array
> Class: com.alipay.spark.proxy.server.biz.service.impl.udf.TransArray
> Usage: N/A.
> Time taken: 0.127 seconds, Fetched 3 row(s)
> spark-sql> select trans_array(1, '\\|', id, position) as (id0, position0) from test_spark limit 10;
> Error in query: Undefined function: 'trans_array'. This function is neither a registered temporary function nor a permanent function registered in the database 'test_db'.; line 1 pos 7
> </code>



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org