You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Ghousia <gh...@gmail.com> on 2011/11/28 06:14:00 UTC
ClassNotFoundException every time we run any hive query
Hi,
We always get this exception for any hive query we run.
org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsPublisher: Error during JDBC
> connection to jdbc:derby:;databaseName=TempStatsStore;create=true.
> java.lang.ClassNotFoundException: org.apache.derby.jdbc.EmbeddedDriver
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:169)
> at
>
org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsPublisher.connect(JDBCStatsPublisher.java:55)
> at
>
org.apache.hadoop.hive.ql.exec.FileSinkOperator.publishStats(FileSinkOperator.java:781)
> at
>
org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:649)
> at
org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:557)
> at
org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> at
org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> at
> org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:303)
> at
> org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:473)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> org.apache.hadoop.hive.ql.exec.FileSinkOperator: StatsPublishing error:
> cannot connect to database
Many Thanks,
Ghousia.
Re: ClassNotFoundException every time we run any hive query
Posted by Eyal B <ey...@gmail.com>.
Add it to the distributed cache
add jar derby.jar;
or
use environment variable HIVE_AUX_JARS_PATH
On Mon, Nov 28, 2011 at 1:29 PM, Ghousia <gh...@gmail.com> wrote:
> Hi Chinna,
>
> I have the derby.jar in the lib folder, hive runs fine and we are able to
> execute the queries. Even then this error shows up in the logs, if the
> query execution is successful. If we closely see this db is for stats not
> for the actual metastore.
>
> -Ghousia.
>
> On Mon, Nov 28, 2011 at 11:49 AM, Chinna Rao Lalam <ch...@huawei.com>wrote:
>
>> Hi,
>>
>>
>>
>> This class "org.apache.derby.jdbc.EmbeddedDriver" will present in the
>> derby.jar normally the hive distribution will come with this jar
>>
>> for example HIVE0.8 will contain derby-10.4.2.0.jar.
>>
>>
>>
>> Check derby.jar present in {HIVE_HOME}/lib or not
>>
>>
>>
>> And version details can u add to the mail..
>>
>>
>>
>> Hope it helps,
>>
>> Chinna Rao Lalam
>>
>>
>> ------------------------------
>> *From:* Ghousia [ghousia.atheeq@gmail.com]
>> *Sent:* Monday, November 28, 2011 1:14 PM
>> *To:* user@hive.apache.org
>> *Subject:* ClassNotFoundException every time we run any hive query
>>
>> Hi,
>>
>> We always get this exception for any hive query we run.
>>
>> org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsPublisher: Error during
>> JDBC
>> > connection to jdbc:derby:;databaseName=TempStatsStore;create=true.
>> > java.lang.ClassNotFoundException: org.apache.derby.jdbc.EmbeddedDriver
>> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>> > at java.security.AccessController.doPrivileged(Native Method)
>> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>> > at java.lang.Class.forName0(Native Method)
>> > at java.lang.Class.forName(Class.java:169)
>> > at
>> >
>> org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsPublisher.connect(JDBCStatsPublisher.java:55)
>> > at
>> >
>> org.apache.hadoop.hive.ql.exec.FileSinkOperator.publishStats(FileSinkOperator.java:781)
>> > at
>> >
>> org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:649)
>> > at
>> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:557)
>> > at
>> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
>> > at
>> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
>> > at
>> > org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:303)
>> > at
>> > org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:473)
>> > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
>> > at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> >> org.apache.hadoop.hive.ql.exec.FileSinkOperator: StatsPublishing error:
>> > cannot connect to database
>>
>>
>> Many Thanks,
>> Ghousia.
>>
>
>
Re: ClassNotFoundException every time we run any hive query
Posted by Ghousia <gh...@gmail.com>.
Hi Chinna,
I have the derby.jar in the lib folder, hive runs fine and we are able to
execute the queries. Even then this error shows up in the logs, if the
query execution is successful. If we closely see this db is for stats not
for the actual metastore.
-Ghousia.
On Mon, Nov 28, 2011 at 11:49 AM, Chinna Rao Lalam <ch...@huawei.com>wrote:
> Hi,
>
>
>
> This class "org.apache.derby.jdbc.EmbeddedDriver" will present in the
> derby.jar normally the hive distribution will come with this jar
>
> for example HIVE0.8 will contain derby-10.4.2.0.jar.
>
>
>
> Check derby.jar present in {HIVE_HOME}/lib or not
>
>
>
> And version details can u add to the mail..
>
>
>
> Hope it helps,
>
> Chinna Rao Lalam
>
>
> ------------------------------
> *From:* Ghousia [ghousia.atheeq@gmail.com]
> *Sent:* Monday, November 28, 2011 1:14 PM
> *To:* user@hive.apache.org
> *Subject:* ClassNotFoundException every time we run any hive query
>
> Hi,
>
> We always get this exception for any hive query we run.
>
> org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsPublisher: Error during JDBC
> > connection to jdbc:derby:;databaseName=TempStatsStore;create=true.
> > java.lang.ClassNotFoundException: org.apache.derby.jdbc.EmbeddedDriver
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> > at java.lang.Class.forName0(Native Method)
> > at java.lang.Class.forName(Class.java:169)
> > at
> >
> org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsPublisher.connect(JDBCStatsPublisher.java:55)
> > at
> >
> org.apache.hadoop.hive.ql.exec.FileSinkOperator.publishStats(FileSinkOperator.java:781)
> > at
> >
> org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:649)
> > at
> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:557)
> > at
> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> > at
> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> > at
> > org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:303)
> > at
> > org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:473)
> > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> > at org.apache.hadoop.mapred.Child.main(Child.java:170)
> >> org.apache.hadoop.hive.ql.exec.FileSinkOperator: StatsPublishing error:
> > cannot connect to database
>
>
> Many Thanks,
> Ghousia.
>
RE: Hive console startup issue
Posted by Chinna Rao Lalam <ch...@huawei.com>.
Hi,
java.lang.NoClassDefFoundError: "jline/ArgumentCompletor$ArgumentDelimiter" this class presents in the "jline.jar".
Check whether this jar is present in the distribution or not in {HIVE_HOME}/lib. If it presents which version it is?
For ex: In trunk distribution jline-0.9.94.jar will be used.
And send which version u r using..
Hope it helps,
Chinna Rao Lalam
________________________________
From: ram prasad [rammca_03@yahoo.co.in]
Sent: Monday, November 28, 2011 6:12 PM
To: Chinna Rao Lalam
Subject: Hive console startup issue
Hi ,
I m unable to start the hive console and getting the below error message
hduser@HBaseSlave2:/usr/local/hive$bin/hive
Exception in thread "main" java.lang.NoClassDefFoundError: jline/ArgumentCompletor$ArgumentDelimiter
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.util.RunJar.main(RunJar.java:149)
Caused by: java.lang.ClassNotFoundException: jline.ArgumentCompletor$ArgumentDelimiter
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 3 more
Can u help on this issue?
Regards,
Ram Prasad
RE: ClassNotFoundException every time we run any hive query
Posted by Chinna Rao Lalam <ch...@huawei.com>.
Hi,
This class "org.apache.derby.jdbc.EmbeddedDriver" will present in the derby.jar normally the hive distribution will come with this jar
for example HIVE0.8 will contain derby-10.4.2.0.jar.
Check derby.jar present in {HIVE_HOME}/lib or not
And version details can u add to the mail..
Hope it helps,
Chinna Rao Lalam
________________________________
From: Ghousia [ghousia.atheeq@gmail.com]
Sent: Monday, November 28, 2011 1:14 PM
To: user@hive.apache.org
Subject: ClassNotFoundException every time we run any hive query
Hi,
We always get this exception for any hive query we run.
org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsPublisher: Error during JDBC
> connection to jdbc:derby:;databaseName=TempStatsStore;create=true.
> java.lang.ClassNotFoundException: org.apache.derby.jdbc.EmbeddedDriver
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:169)
> at
> org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsPublisher.connect(JDBCStatsPublisher.java:55)
> at
> org.apache.hadoop.hive.ql.exec.FileSinkOperator.publishStats(FileSinkOperator.java:781)
> at
> org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:649)
> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:557)
> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> at
> org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:303)
> at
> org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:473)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> org.apache.hadoop.hive.ql.exec.FileSinkOperator: StatsPublishing error:
> cannot connect to database
Many Thanks,
Ghousia.