You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by Ganesha Muthuraman <mg...@outlook.com> on 2015/03/31 20:31:15 UTC
Hive SerDe Error
Posting this message again as I did not get a response to the previous:
I
am getting a hive custom SerDe not found error when I try to describe (or query) hive
tables in drill that use a custom SerDe. show tables works ok. Also, any
table that does not use custom SerDe, works well. All tables work fine in Hive shell.
I’m
trying this in Cloudera Hadoop. Tried this in both CDH VM and an actual CDH
cluster (5.2.0) with the same observation. In the VM, it was an embedded
configuration, whereas in the cluster it was a distributed one. Tried copying
the custom SerDe Jar to jars/3rdparty directory but to no avail. Any help will
be appreciated.
I do have the SerDe jar in /usr/lib/hive/lib
-Ganesh
RE: Hive SerDe Error
Posted by Ganesha Muthuraman <mg...@outlook.com>.
Thank you David. I will try this one.
-Ganesh
> Subject: Re: Hive SerDe Error
> From: dtucker@maprtech.com
> Date: Tue, 31 Mar 2015 13:26:30 -0700
> To: user@drill.apache.org
>
> I believe you’ll need to put the custom jar in DRILL’s classpath (it does not include $HIVE_HOME/lib be default since there’s no guarantee it will be on all cluster nodes).
>
> I’ve been successful putting the extra libraries I need for object-store access into $DRILL_HOME/jars/3rdparty.
>
> — David
>
> On Mar 31, 2015, at 11:31 AM, Ganesha Muthuraman <mg...@outlook.com> wrote:
>
> > Posting this message again as I did not get a response to the previous:
> > I
> > am getting a hive custom SerDe not found error when I try to describe (or query) hive
> > tables in drill that use a custom SerDe. show tables works ok. Also, any
> > table that does not use custom SerDe, works well. All tables work fine in Hive shell.
> >
> >
> >
> > I’m
> > trying this in Cloudera Hadoop. Tried this in both CDH VM and an actual CDH
> > cluster (5.2.0) with the same observation. In the VM, it was an embedded
> > configuration, whereas in the cluster it was a distributed one. Tried copying
> > the custom SerDe Jar to jars/3rdparty directory but to no avail. Any help will
> > be appreciated.
> > I do have the SerDe jar in /usr/lib/hive/lib
> > -Ganesh
>
Re: Hive SerDe Error
Posted by David Tucker <dt...@maprtech.com>.
I believe you’ll need to put the custom jar in DRILL’s classpath (it does not include $HIVE_HOME/lib be default since there’s no guarantee it will be on all cluster nodes).
I’ve been successful putting the extra libraries I need for object-store access into $DRILL_HOME/jars/3rdparty.
— David
On Mar 31, 2015, at 11:31 AM, Ganesha Muthuraman <mg...@outlook.com> wrote:
> Posting this message again as I did not get a response to the previous:
> I
> am getting a hive custom SerDe not found error when I try to describe (or query) hive
> tables in drill that use a custom SerDe. show tables works ok. Also, any
> table that does not use custom SerDe, works well. All tables work fine in Hive shell.
>
>
>
> I’m
> trying this in Cloudera Hadoop. Tried this in both CDH VM and an actual CDH
> cluster (5.2.0) with the same observation. In the VM, it was an embedded
> configuration, whereas in the cluster it was a distributed one. Tried copying
> the custom SerDe Jar to jars/3rdparty directory but to no avail. Any help will
> be appreciated.
> I do have the SerDe jar in /usr/lib/hive/lib
> -Ganesh