You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Aryeh Berkowitz <ar...@iswcorp.com> on 2010/02/23 15:29:06 UTC
Missing Hive Execution Jar
I'm trying to run Hive, but I'm getting the message Missing Hive Execution Jar: hive/lib/hive-exec-*.jar. I followed all the download and build instructions on the Wiki page.
Re: Missing Hive Execution Jar
Posted by Carl Steinbach <ca...@cloudera.com>.
Hi Aryeh,
I greped through the source code for the string "does not have a scheme" and
traced it back to HiveMetaStoreClient.java where the error you see is
getting thrown. This code should print the value of 'hive.metastore.uris' in
the error message0, but it doesn't. I recommend modifying the code so that
it prints the value of this property when it throws the error message. Then
you will need to figure out where you are setting this value. If not in
hive-default.xml, then maybe you are setting it in hive-site.xml, or on the
command line using the -hiveconf switch?
Thanks.
Carl
On Wed, Feb 24, 2010 at 5:53 AM, Aryeh Berkowitz <ar...@iswcorp.com> wrote:
> I don’t seem to have that configuration property in my hive-default. What
> should it be?
>
>
>
> *From:* Carl Steinbach [mailto:carl@cloudera.com]
> *Sent:* Tuesday, February 23, 2010 3:47 PM
>
> *To:* hive-user@hadoop.apache.org
> *Subject:* Re: Missing Hive Execution Jar
>
>
>
> I think it's complaining about the value you have set for the configuration
> property "hive.metastore.uris". Are you setting this on the command line, or
> does it appear in your Hive configuration file? If so, what is the value?
>
> Carl
>
> On Tue, Feb 23, 2010 at 11:58 AM, Aryeh Berkowitz <ar...@iswcorp.com>
> wrote:
>
> Thanks Carl! I’m now getting the following error:
>
>
>
> 10/02/23 14:57:47 ERROR exec.DDLTask: FAILED: Error in metadata:
> java.lang.IllegalArgumentException: URI: does not have a scheme
>
> org.apache.hadoop.hive.ql.metadata.HiveException:
> java.lang.IllegalArgumentException: URI: does not have a scheme
>
> at
> org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:326)
>
> at
> org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:1391)
>
> at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:123)
>
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:107)
>
> at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
>
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:630)
>
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:504)
>
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:382)
>
> at
> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:138)
>
> at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:197)
>
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:303)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>
> Caused by: java.lang.IllegalArgumentException: URI: does not have a scheme
>
> at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:92)
>
> at
> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:921)
>
> at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:931)
>
> at
> org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:320)
>
> ... 15 more
>
>
>
> *From:* Carl Steinbach [mailto:carl@cloudera.com]
> *Sent:* Tuesday, February 23, 2010 2:13 PM
>
>
> *To:* hive-user@hadoop.apache.org
> *Subject:* Re: Missing Hive Execution Jar
>
>
>
> > I’m trying to run Hive, but I’m getting the message Missing Hive
>
>
> > Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
> > d and build instructions on the Wiki page.
>
>
> It sounds like you are trying to run the hive script located in bin/
> instead of the one located in build/dist/bin (build/dist is the default
> installation directory). Assuming that you have the Hive source code checked
> out to a directory named hive-trunk and that you built Hive without
> specifying the 'target.dir' property, you want HIVE_HOME to point to
> hive-trunk/build/dist, and you should add $HIVE_HOME/bin to your PATH. So
> when you run 'hive' it should pick up the copy in hive-trunk/build/dist/bin
> instead of the version in hive-trunk/bin.
>
>
>
> Do a find | grep jar, in hive's directory, then cp all jars found to
> lib/ off the main hive directory. There are several that are not
> automatically copied there as part of the build, and this will fix
> things.
>
>
> Please don't do this. There are conflicting versions of libthrift and
> libfb303 located in subdirectories of the Hive source tree. Ordinarily this
> does not cause a problem since they don't end up on the CLASSPATH. If you
> already copied all of the jars to lib/ you should probably rm -rf your
> workspace and do a fresh checkout and build.
>
> Thanks.
>
> Carl
>
>
>
>
>
>
>
>
RE: Missing Hive Execution Jar
Posted by Aryeh Berkowitz <ar...@iswcorp.com>.
I don't seem to have that configuration property in my hive-default. What should it be?
From: Carl Steinbach [mailto:carl@cloudera.com]
Sent: Tuesday, February 23, 2010 3:47 PM
To: hive-user@hadoop.apache.org
Subject: Re: Missing Hive Execution Jar
I think it's complaining about the value you have set for the configuration property "hive.metastore.uris". Are you setting this on the command line, or does it appear in your Hive configuration file? If so, what is the value?
Carl
On Tue, Feb 23, 2010 at 11:58 AM, Aryeh Berkowitz <ar...@iswcorp.com>> wrote:
Thanks Carl! I'm now getting the following error:
10/02/23 14:57:47 ERROR exec.DDLTask: FAILED: Error in metadata: java.lang.IllegalArgumentException: URI: does not have a scheme
org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.IllegalArgumentException: URI: does not have a scheme
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:326)
at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:1391)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:123)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:107)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:630)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:504)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:382)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:138)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:197)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:303)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: java.lang.IllegalArgumentException: URI: does not have a scheme
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:92)
at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:921)
at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:931)
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:320)
... 15 more
From: Carl Steinbach [mailto:carl@cloudera.com<ma...@cloudera.com>]
Sent: Tuesday, February 23, 2010 2:13 PM
To: hive-user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: Missing Hive Execution Jar
> I'm trying to run Hive, but I'm getting the message Missing Hive
> Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
> d and build instructions on the Wiki page.
It sounds like you are trying to run the hive script located in bin/ instead of the one located in build/dist/bin (build/dist is the default installation directory). Assuming that you have the Hive source code checked out to a directory named hive-trunk and that you built Hive without specifying the 'target.dir' property, you want HIVE_HOME to point to hive-trunk/build/dist, and you should add $HIVE_HOME/bin to your PATH. So when you run 'hive' it should pick up the copy in hive-trunk/build/dist/bin instead of the version in hive-trunk/bin.
Do a find | grep jar, in hive's directory, then cp all jars found to
lib/ off the main hive directory. There are several that are not
automatically copied there as part of the build, and this will fix
things.
Please don't do this. There are conflicting versions of libthrift and libfb303 located in subdirectories of the Hive source tree. Ordinarily this does not cause a problem since they don't end up on the CLASSPATH. If you already copied all of the jars to lib/ you should probably rm -rf your workspace and do a fresh checkout and build.
Thanks.
Carl
Re: Missing Hive Execution Jar
Posted by Carl Steinbach <ca...@cloudera.com>.
I think it's complaining about the value you have set for the configuration
property "hive.metastore.uris". Are you setting this on the command line, or
does it appear in your Hive configuration file? If so, what is the value?
Carl
On Tue, Feb 23, 2010 at 11:58 AM, Aryeh Berkowitz <ar...@iswcorp.com> wrote:
> Thanks Carl! I’m now getting the following error:
>
>
>
> 10/02/23 14:57:47 ERROR exec.DDLTask: FAILED: Error in metadata:
> java.lang.IllegalArgumentException: URI: does not have a scheme
>
> org.apache.hadoop.hive.ql.metadata.HiveException:
> java.lang.IllegalArgumentException: URI: does not have a scheme
>
> at
> org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:326)
>
> at
> org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:1391)
>
> at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:123)
>
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:107)
>
> at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
>
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:630)
>
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:504)
>
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:382)
>
> at
> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:138)
>
> at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:197)
>
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:303)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>
> Caused by: java.lang.IllegalArgumentException: URI: does not have a scheme
>
> at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:92)
>
> at
> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:921)
>
> at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:931)
>
> at
> org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:320)
>
> ... 15 more
>
>
>
> *From:* Carl Steinbach [mailto:carl@cloudera.com]
> *Sent:* Tuesday, February 23, 2010 2:13 PM
>
> *To:* hive-user@hadoop.apache.org
> *Subject:* Re: Missing Hive Execution Jar
>
>
>
> > I’m trying to run Hive, but I’m getting the message Missing Hive
>
> > Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
> > d and build instructions on the Wiki page.
>
>
> It sounds like you are trying to run the hive script located in bin/
> instead of the one located in build/dist/bin (build/dist is the default
> installation directory). Assuming that you have the Hive source code checked
> out to a directory named hive-trunk and that you built Hive without
> specifying the 'target.dir' property, you want HIVE_HOME to point to
> hive-trunk/build/dist, and you should add $HIVE_HOME/bin to your PATH. So
> when you run 'hive' it should pick up the copy in hive-trunk/build/dist/bin
> instead of the version in hive-trunk/bin.
>
>
>
> Do a find | grep jar, in hive's directory, then cp all jars found to
> lib/ off the main hive directory. There are several that are not
> automatically copied there as part of the build, and this will fix
> things.
>
>
> Please don't do this. There are conflicting versions of libthrift and
> libfb303 located in subdirectories of the Hive source tree. Ordinarily this
> does not cause a problem since they don't end up on the CLASSPATH. If you
> already copied all of the jars to lib/ you should probably rm -rf your
> workspace and do a fresh checkout and build.
>
> Thanks.
>
> Carl
>
>
>
>
>
>
RE: Missing Hive Execution Jar
Posted by Aryeh Berkowitz <ar...@iswcorp.com>.
Thanks Carl! I'm now getting the following error:
10/02/23 14:57:47 ERROR exec.DDLTask: FAILED: Error in metadata: java.lang.IllegalArgumentException: URI: does not have a scheme
org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.IllegalArgumentException: URI: does not have a scheme
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:326)
at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:1391)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:123)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:107)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:630)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:504)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:382)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:138)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:197)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:303)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: java.lang.IllegalArgumentException: URI: does not have a scheme
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:92)
at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:921)
at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:931)
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:320)
... 15 more
From: Carl Steinbach [mailto:carl@cloudera.com]
Sent: Tuesday, February 23, 2010 2:13 PM
To: hive-user@hadoop.apache.org
Subject: Re: Missing Hive Execution Jar
> I'm trying to run Hive, but I'm getting the message Missing Hive
> Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
> d and build instructions on the Wiki page.
It sounds like you are trying to run the hive script located in bin/ instead of the one located in build/dist/bin (build/dist is the default installation directory). Assuming that you have the Hive source code checked out to a directory named hive-trunk and that you built Hive without specifying the 'target.dir' property, you want HIVE_HOME to point to hive-trunk/build/dist, and you should add $HIVE_HOME/bin to your PATH. So when you run 'hive' it should pick up the copy in hive-trunk/build/dist/bin instead of the version in hive-trunk/bin.
Do a find | grep jar, in hive's directory, then cp all jars found to
lib/ off the main hive directory. There are several that are not
automatically copied there as part of the build, and this will fix
things.
Please don't do this. There are conflicting versions of libthrift and libfb303 located in subdirectories of the Hive source tree. Ordinarily this does not cause a problem since they don't end up on the CLASSPATH. If you already copied all of the jars to lib/ you should probably rm -rf your workspace and do a fresh checkout and build.
Thanks.
Carl
Re: Missing Hive Execution Jar
Posted by Carl Steinbach <ca...@cloudera.com>.
>
> > I’m trying to run Hive, but I’m getting the message Missing Hive
> > Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
> > d and build instructions on the Wiki page.
>
It sounds like you are trying to run the hive script located in bin/ instead
of the one located in build/dist/bin (build/dist is the default installation
directory). Assuming that you have the Hive source code checked out to a
directory named hive-trunk and that you built Hive without specifying the
'target.dir' property, you want HIVE_HOME to point to hive-trunk/build/dist,
and you should add $HIVE_HOME/bin to your PATH. So when you run 'hive' it
should pick up the copy in hive-trunk/build/dist/bin instead of the version
in hive-trunk/bin.
Do a find | grep jar, in hive's directory, then cp all jars found to
> lib/ off the main hive directory. There are several that are not
> automatically copied there as part of the build, and this will fix
> things.
>
Please don't do this. There are conflicting versions of libthrift and
libfb303 located in subdirectories of the Hive source tree. Ordinarily this
does not cause a problem since they don't end up on the CLASSPATH. If you
already copied all of the jars to lib/ you should probably rm -rf your
workspace and do a fresh checkout and build.
Thanks.
Carl
RE: Missing Hive Execution Jar
Posted by Aryeh Berkowitz <ar...@iswcorp.com>.
I can't find anything. If you can tell me what it is, I'd appreciate it. Thanks!
-----Original Message-----
From: Russell Jurney [mailto:russell.jurney@gmail.com]
Sent: Tuesday, February 23, 2010 10:15 AM
To: hive-user@hadoop.apache.org
Subject: Re: Missing Hive Execution Jar
Sounds like the aforementioned environment variable issue. I'm not at
a computer to look it up, but I found the path to set by googling the
error message, so try that. It was on the first page.
Russ
On Feb 23, 2010, at 10:08 AM, Aryeh Berkowitz <ar...@iswcorp.com> wrote:
> Thanks! I'm now getting an "Unable to determine Hadoop version
> information" error.
>
> -----Original Message-----
> From: Russell Jurney [mailto:russell.jurney@gmail.com]
> Sent: Tuesday, February 23, 2010 9:35 AM
> To: hive-user@hadoop.apache.org
> Subject: Re: Missing Hive Execution Jar
>
> Do a find | grep jar, in hive's directory, then cp all jars found to
> lib/ off the main hive directory. There are several that are not
> automatically copied there as part of the build, and this will fix
> things.
>
> I also had to set some env var, but I can't remember which one.
>
> Russ
>
> On Feb 23, 2010, at 9:29 AM, Aryeh Berkowitz <ar...@iswcorp.com>
> wrote:
>
>> I'm trying to run Hive, but I'm getting the message Missing Hive
>> Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
>> d and build instructions on the Wiki page.
Re: Missing Hive Execution Jar
Posted by Russell Jurney <ru...@gmail.com>.
Sounds like the aforementioned environment variable issue. I'm not at
a computer to look it up, but I found the path to set by googling the
error message, so try that. It was on the first page.
Russ
On Feb 23, 2010, at 10:08 AM, Aryeh Berkowitz <ar...@iswcorp.com> wrote:
> Thanks! I'm now getting an "Unable to determine Hadoop version
> information" error.
>
> -----Original Message-----
> From: Russell Jurney [mailto:russell.jurney@gmail.com]
> Sent: Tuesday, February 23, 2010 9:35 AM
> To: hive-user@hadoop.apache.org
> Subject: Re: Missing Hive Execution Jar
>
> Do a find | grep jar, in hive's directory, then cp all jars found to
> lib/ off the main hive directory. There are several that are not
> automatically copied there as part of the build, and this will fix
> things.
>
> I also had to set some env var, but I can't remember which one.
>
> Russ
>
> On Feb 23, 2010, at 9:29 AM, Aryeh Berkowitz <ar...@iswcorp.com>
> wrote:
>
>> I'm trying to run Hive, but I'm getting the message Missing Hive
>> Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
>> d and build instructions on the Wiki page.
RE: Missing Hive Execution Jar
Posted by Aryeh Berkowitz <ar...@iswcorp.com>.
Thanks! I'm now getting an "Unable to determine Hadoop version information" error.
-----Original Message-----
From: Russell Jurney [mailto:russell.jurney@gmail.com]
Sent: Tuesday, February 23, 2010 9:35 AM
To: hive-user@hadoop.apache.org
Subject: Re: Missing Hive Execution Jar
Do a find | grep jar, in hive's directory, then cp all jars found to
lib/ off the main hive directory. There are several that are not
automatically copied there as part of the build, and this will fix
things.
I also had to set some env var, but I can't remember which one.
Russ
On Feb 23, 2010, at 9:29 AM, Aryeh Berkowitz <ar...@iswcorp.com> wrote:
> I'm trying to run Hive, but I'm getting the message Missing Hive
> Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
> d and build instructions on the Wiki page.
Re: Missing Hive Execution Jar
Posted by Russell Jurney <ru...@gmail.com>.
Do a find | grep jar, in hive's directory, then cp all jars found to
lib/ off the main hive directory. There are several that are not
automatically copied there as part of the build, and this will fix
things.
I also had to set some env var, but I can't remember which one.
Russ
On Feb 23, 2010, at 9:29 AM, Aryeh Berkowitz <ar...@iswcorp.com> wrote:
> I’m trying to run Hive, but I’m getting the message Missing Hive
> Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
> d and build instructions on the Wiki page.