You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Abhijit Pol <ap...@rocketfuelinc.com> on 2009/09/29 04:09:43 UTC

hive server error

Hi,

I am trying to issue hive queries using hive server. I am using hive 0.4,
hadoop 0.18.3, and JDBC client as is from Hive Client Wiki page. The hive
server is running at default port 10000.

For all sort of simple queries I am getting following error:

Hive history
file=/tmp/hadoop/hive_job_log_hadoop_200909282046_1438698666.txt
09/09/28 20:46:32 INFO exec.HiveHistory: Hive history
file=/tmp/hadoop/hive_job_log_hadoop_200909282046_1438698666.txt
Exception in thread "pool-1-thread-23" java.lang.NoSuchMethodError:
com.facebook.fb303.FacebookService$Processor$ProcessFunction.process(ILorg/apache/thrift/protocol/TProtocol;Lorg/apache/thrift/protocol/TProtocol;)V
    at
org.apache.hadoop.hive.service.ThriftHive$Processor.process(ThriftHive.java:328)
    at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:252)
    at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
    at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
    at java.lang.Thread.run(Thread.java:619)


I am able to get JDBC connection and error occurs when I issue
statement.executeQuery(sql)

Thanks,
Abhi

Re: hive server error

Posted by Abhijit Pol <ap...@rocketfuelinc.com>.
It seems that libfb303 packaged with 0.18.3 cloudera distro is old one. The
hive server adds both, libfbt303 from hadoop lib folder and libfb303 from
hive lib folder to classpath, in that order. Appeartnly first one gets
preference causing this error.

Pointed hadoop libfb303 to hive libfb303 and now its working.

Thanks Raghu for pointer.
Abhi


On Tue, Sep 29, 2009 at 12:38 AM, Abhijit Pol <ap...@rocketfuelinc.com>wrote:

> I have libfb303.jar, libthrift.jar and all other jars in hive lib
> directory and I am using following to build classpath.
>
> #!/bin/bash
> HADOOP_CORE=`ls $HADOOP_HOME/hadoop-*-core.jar`
> CLASSPATH=.:$HADOOP_CORE:$HIVE_HOME/conf
> for i in ${HIVE_HOME}/lib/*.jar ; do
>    CLASSPATH=$CLASSPATH:$i
> done
> echo $CLASSPATH
> javac HiveJdbcClient.java
> java -cp $CLASSPATH HiveJdbcClient
> <EOF>
>
> I can see all jars in the classpath.
> Did you mean any thing different with "classpath of your server"? I
> simply used bin/hive --service hiveserver, to start  the server.
>
> Thanks,
> Abhi
>
>
> On Mon, Sep 28, 2009 at 7:26 PM, Raghu Murthy <rm...@facebook.com>
> wrote:
> >
> > Looks like libfb303.jar is not in the classpath of your server. Can you
> > verify?
> >
> >
> > On 9/28/09 7:09 PM, "Abhijit Pol" <ap...@rocketfuelinc.com> wrote:
> >
> > > Hi,
> > >
> > > I am trying to issue hive queries using hive server. I am using hive
> 0.4,
> > > hadoop 0.18.3, and JDBC client as is from Hive Client Wiki page. The
> hive
> > > server is running at default port 10000.
> > >
> > > For all sort of simple queries I am getting following error:
> > >
> > > Hive history
> file=/tmp/hadoop/hive_job_log_hadoop_200909282046_1438698666.txt
> > > 09/09/28 20:46:32 INFO exec.HiveHistory: Hive history
> > > file=/tmp/hadoop/hive_job_log_hadoop_200909282046_1438698666.txt
> > > Exception in thread "pool-1-thread-23" java.lang.NoSuchMethodError:
> > >
> com.facebook.fb303.FacebookService$Processor$ProcessFunction.process(ILorg/apa
> > > che/thrift/protocol/TProtocol;Lorg/apache/thrift/protocol/TProtocol;)V
> > >     at
> > >
> org.apache.hadoop.hive.service.ThriftHive$Processor.process(ThriftHive.java:32
> > > 8)
> > >     at
> > >
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer
> > > .java:252)
> > >     at
> > >
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java
> > > :886)
> > >     at
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908>
> > )
> > >     at java.lang.Thread.run(Thread.java:619)
> > >
> > >
> > > I am able to get JDBC connection and error occurs when I issue
> > > statement.executeQuery(sql)
> > >
> > > Thanks,
> > > Abhi
> >
>

Re: hive server error

Posted by Abhijit Pol <ap...@rocketfuelinc.com>.
I have libfb303.jar, libthrift.jar and all other jars in hive lib
directory and I am using following to build classpath.

#!/bin/bash
HADOOP_CORE=`ls $HADOOP_HOME/hadoop-*-core.jar`
CLASSPATH=.:$HADOOP_CORE:$HIVE_HOME/conf
for i in ${HIVE_HOME}/lib/*.jar ; do
    CLASSPATH=$CLASSPATH:$i
done
echo $CLASSPATH
javac HiveJdbcClient.java
java -cp $CLASSPATH HiveJdbcClient
<EOF>

I can see all jars in the classpath.
Did you mean any thing different with "classpath of your server"? I
simply used bin/hive --service hiveserver, to start  the server.

Thanks,
Abhi


On Mon, Sep 28, 2009 at 7:26 PM, Raghu Murthy <rm...@facebook.com> wrote:
>
> Looks like libfb303.jar is not in the classpath of your server. Can you
> verify?
>
>
> On 9/28/09 7:09 PM, "Abhijit Pol" <ap...@rocketfuelinc.com> wrote:
>
> > Hi,
> >
> > I am trying to issue hive queries using hive server. I am using hive 0.4,
> > hadoop 0.18.3, and JDBC client as is from Hive Client Wiki page. The hive
> > server is running at default port 10000.
> >
> > For all sort of simple queries I am getting following error:
> >
> > Hive history file=/tmp/hadoop/hive_job_log_hadoop_200909282046_1438698666.txt
> > 09/09/28 20:46:32 INFO exec.HiveHistory: Hive history
> > file=/tmp/hadoop/hive_job_log_hadoop_200909282046_1438698666.txt
> > Exception in thread "pool-1-thread-23" java.lang.NoSuchMethodError:
> > com.facebook.fb303.FacebookService$Processor$ProcessFunction.process(ILorg/apa
> > che/thrift/protocol/TProtocol;Lorg/apache/thrift/protocol/TProtocol;)V
> >     at
> > org.apache.hadoop.hive.service.ThriftHive$Processor.process(ThriftHive.java:32
> > 8)
> >     at
> > org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer
> > .java:252)
> >     at
> > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java
> > :886)
> >     at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908>
> )
> >     at java.lang.Thread.run(Thread.java:619)
> >
> >
> > I am able to get JDBC connection and error occurs when I issue
> > statement.executeQuery(sql)
> >
> > Thanks,
> > Abhi
>

Re: hive server error

Posted by Raghu Murthy <rm...@facebook.com>.
Looks like libfb303.jar is not in the classpath of your server. Can you
verify?


On 9/28/09 7:09 PM, "Abhijit Pol" <ap...@rocketfuelinc.com> wrote:

> Hi,
> 
> I am trying to issue hive queries using hive server. I am using hive 0.4,
> hadoop 0.18.3, and JDBC client as is from Hive Client Wiki page. The hive
> server is running at default port 10000.
> 
> For all sort of simple queries I am getting following error:
> 
> Hive history file=/tmp/hadoop/hive_job_log_hadoop_200909282046_1438698666.txt
> 09/09/28 20:46:32 INFO exec.HiveHistory: Hive history
> file=/tmp/hadoop/hive_job_log_hadoop_200909282046_1438698666.txt
> Exception in thread "pool-1-thread-23" java.lang.NoSuchMethodError:
> com.facebook.fb303.FacebookService$Processor$ProcessFunction.process(ILorg/apa
> che/thrift/protocol/TProtocol;Lorg/apache/thrift/protocol/TProtocol;)V
>     at 
> org.apache.hadoop.hive.service.ThriftHive$Processor.process(ThriftHive.java:32
> 8)
>     at 
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer
> .java:252)
>     at 
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java
> :886)
>     at 
> 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908>
)
>     at java.lang.Thread.run(Thread.java:619)
> 
> 
> I am able to get JDBC connection and error occurs when I issue
> statement.executeQuery(sql)
> 
> Thanks,
> Abhi