You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Ravisankar Mani <rr...@gmail.com> on 2015/07/14 11:30:21 UTC

Udf's in spark

Hi Everyone,

As mentioned in Spark sQL programming guide, Spark SQL support Hive UDFs.
I have built the UDF's in hive meta store. It working perfectly in hive
connection. But it is not working in spark ("java.lang.RuntimeException:
Couldn't find function DATE_FORMAT").

Could you please help how to use this hive UDF' s in sprak?


Regards,

Ravisankar M R

Re: Udf's in spark

Posted by Takeshi Yamamuro <li...@gmail.com>.

Sure and sparksql supports Hive UDFs.
ISTM that the UDF 'DATE_FORMAT' is just not registered in your metastore?
Did you say 'CREATE FUNCTION' in advance?

Thanks,

On Tue, Jul 14, 2015 at 6:30 PM, Ravisankar Mani <rr...@gmail.com> wrote:

> Hi Everyone,
>
> As mentioned in Spark sQL programming guide, Spark SQL support Hive UDFs.
> I have built the UDF's in hive meta store. It working perfectly in hive
> connection. But it is not working in spark ("java.lang.RuntimeException:
> Couldn't find function DATE_FORMAT").
>
> Could you please help how to use this hive UDF' s in sprak?
>
>
> Regards,
>
> Ravisankar M R
>

-- 
---
Takeshi Yamamuro