You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Raj Hadoop <ha...@yahoo.com> on 2016/04/04 19:25:01 UTC

Unable to start Hive CLI after install

Hi,
I have downloaded apache hive 1.1.1 and trying to setup hive environment in my hadoop cluster.
On one of the nodes i installed hive and when i set all the variables and environment i am getting the following error.Please advise.

[hadoop@z1 bin]$ hive
2016-04-04 10:12:45,686 WARN  [main] conf.HiveConf (HiveConf.java:initialize(2605)) - HiveConf of name hive.metastore.local does not exist

Logging initialized using configuration in jar:file:/home/hadoop/hive/hive111/lib/hive-common-1.1.1.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/hadoop/hadoop262/hadoop262/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hadoop/hive/hive111/lib/hive-jdbc-1.1.1-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
    at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:472)
    at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671)
    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:615)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
    at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1485)
    at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:64)
    at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:74)
    at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2841)
    at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2860)
    at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:453)
    ... 8 more
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
    at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1483)
    ... 13 more
Caused by: javax.jdo.JDOFatalInternalException: Error creating transactional connection factory
NestedThrowables:
java.lang.reflect.InvocationTargetException
    at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:587)
    at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:78


Regards,Raj


Re: Unable to start Hive CLI after install

Posted by Mich Talebzadeh <mi...@gmail.com>.
What are you getting when trying

$HIVE_HOME/bin/hive

The error!

Dr Mich Talebzadeh



LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*



http://talebzadehmich.wordpress.com



On 4 April 2016 at 20:38, Raj Hadoop <ha...@yahoo.com> wrote:

> Hi Mich -
> I did all those steps. Some how i am not able to find out whats the issue.
> Can you suggest any debugging tips ?
> Regards,
> Rajendra
>
>
>
> On Monday, April 4, 2016 12:16 PM, Mich Talebzadeh <
> mich.talebzadeh@gmail.com> wrote:
>
>
> HI Raj,
>
> Hive 2 is as good to go :) Check this
> <https://www.linkedin.com/pulse/apache-hive-2-now-released-mich-talebzadeh-ph-d-?trk=prof-post>
>
> I see that you are using Oracle DB as your metastore. Mine is Oracle as
> well
>
>   <property>
>     <name>javax.jdo.option.ConnectionURL</name>
>     <value>jdbc:oracle:thin:@rhes564:1521:mydb</value>
>     <description>JDBC connect string for a JDBC metastore</description>
>   </property>
>
> Also need username/password for your metastore
>
>   <property>
>     <name>javax.jdo.option.ConnectionUserName</name>
>     <value>hiveuser</value>
>     <description>Username to use against metastore database</description>
>   </property>
>
>   <property>
>     <name>javax.jdo.option.ConnectionPassword</name>
>     <value>xxxxxxx</value>
>     <description>password to use against metastore database</description>
>   </property>
>
> Now you also need to put Oracle jar file ojdbc6.jar in $HIVE_HOME/lib otherwise
> you won't be able to connect
>
> HTH
>
> Dr Mich Talebzadeh
>
> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>
> http://talebzadehmich.wordpress.com
>
>
> On 4 April 2016 at 20:02, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Sorry in a typo with your name - Mich.
>
>
> On Monday, April 4, 2016 12:01 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>
> Thanks Mike. If Hive 2.0 is stable - i would definitely go for it. But let
> me troubleshoot 1.1.1 issues i am facing now.
>
> here is my hive-site.xml. Can you please let me know if i am missing
> anything.
>
> <property>
> <name>hive.exec.scratchdir</name>
> <value>/tmp/hive</value>
> </property>
>
>
> <property>
> <name>hive.metastore.local</name>
> <value>false</value>
> </property>
>
>
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value>hdfs://z1:8899/user/hive/warehouse</value>
> </property>
>
> <property>
> <name>javax.jdo.option.ConnectionURL</name>
> <value>jdbc:oracle:thin:@//z4:1521/xe</value>
> </property>
>
> <property>
> <name>javax.jdo.option.ConnectionDriverName</name>
> <value>com.oracle.jdbc.Driver</value>
> </property>
>
> <property>
> <name>javax.jdo.option.ConnectionUserName</name>
> <value>hive</value>
> </property>
>
> <property>
> <name>javax.jdo.option.ConnectionPassword</name>
> <value>hive</value>
> </property>
>
>
> <property>
>     <name>hive.querylog.location</name>
>     <value>$HIVE_HOME/iotmp</value>
>     <description>Location of Hive run time structured log
> file</description>
>   </property>
>
>   <property>
>     <name>hive.exec.local.scratchdir</name>
>     <value>$HIVE_HOME/iotmp</value>
>     <description>Local scratch space for Hive jobs</description>
>   </property>
>
>   <property>
>     <name>hive.downloaded.resources.dir</name>
>     <value>$HIVE_HOME/iotmp</value>
>     <description>Temporary local directory for added resources in the
> remote file system.</description>
>   </property>
>
>
> </configuration>
>
>
> On Monday, April 4, 2016 11:46 AM, Mich Talebzadeh <
> mich.talebzadeh@gmail.com> wrote:
>
>
> Interesting why you did not download Hive 2.0 which is out now
>
> The error says:
>
>  HiveConf of name hive.metastore.local does not exist
>
> In you hive-site.xml how have you configured parameters for hive.metastore?
>
> HTH
>
>
> Dr Mich Talebzadeh
>
> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>
> http://talebzadehmich.wordpress.com
>
>
> On 4 April 2016 at 18:25, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Hi,
>
> I have downloaded apache hive 1.1.1 and trying to setup hive environment
> in my hadoop cluster.
>
> On one of the nodes i installed hive and when i set all the variables and
> environment i am getting the following error.
> Please advise.
>
> [hadoop@z1 bin]$ hive
> 2016-04-04 10:12:45,686 WARN  [main] conf.HiveConf
> (HiveConf.java:initialize(2605)) - HiveConf of name hive.metastore.local
> does not exist
>
> Logging initialized using configuration in
> jar:file:/home/hadoop/hive/hive111/lib/hive-common-1.1.1.jar!/hive-log4j.properties
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/home/hadoop/hadoop262/hadoop262/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/home/hadoop/hive/hive111/lib/hive-jdbc-1.1.1-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> Exception in thread "main" java.lang.RuntimeException:
> java.lang.RuntimeException: Unable to instantiate
> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
>     at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:472)
>     at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671)
>     at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:615)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:606)
>     at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
> Caused by: java.lang.RuntimeException: Unable to instantiate
> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
>     at
> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1485)
>     at
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:64)
>     at
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:74)
>     at
> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2841)
>     at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2860)
>     at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:453)
>     ... 8 more
> Caused by: java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>     at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>     at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>     at
> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1483)
>     ... 13 more
> Caused by: javax.jdo.JDOFatalInternalException: Error creating
> transactional connection factory
> NestedThrowables:
> java.lang.reflect.InvocationTargetException
>     at
> org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:587)
>     at
> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:78
>
>
>
> Regards,
> Raj
>
>
>
>
>
>
>
>
>
>

Re: Unable to start Hive CLI after install

Posted by Raj Hadoop <ha...@yahoo.com>.
Hi Mich -I did all those steps. Some how i am not able to find out whats the issue. Can you suggest any debugging tips ?Regards,Rajendra

 

    On Monday, April 4, 2016 12:16 PM, Mich Talebzadeh <mi...@gmail.com> wrote:
 

 HI Raj,
Hive 2 is as good to go :) Check this
I see that you are using Oracle DB as your metastore. Mine is Oracle as well
  <property>
    <name>javax.jdo.option.ConnectionURL</name>
    <value>jdbc:oracle:thin:@rhes564:1521:mydb</value>
    <description>JDBC connect string for a JDBC metastore</description>
  </property>
Also need username/password for your metastore
  <property>
    <name>javax.jdo.option.ConnectionUserName</name>
    <value>hiveuser</value>
    <description>Username to use against metastore database</description>
  </property>
  <property>
    <name>javax.jdo.option.ConnectionPassword</name>
    <value>xxxxxxx</value>
    <description>password to use against metastore database</description>
  </property>

Now you also need to put Oracle jar file ojdbc6.jar in $HIVE_HOME/lib otherwise you won't be able to connect
HTH

Dr Mich Talebzadeh LinkedIn  https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw http://talebzadehmich.wordpress.com 
On 4 April 2016 at 20:02, Raj Hadoop <ha...@yahoo.com> wrote:

Sorry in a typo with your name - Mich.
 

    On Monday, April 4, 2016 12:01 PM, Raj Hadoop <ha...@yahoo.com> wrote:
 

 Thanks Mike. If Hive 2.0 is stable - i would definitely go for it. But let me troubleshoot 1.1.1 issues i am facing now.
here is my hive-site.xml. Can you please let me know if i am missing anything.

<property>
<name>hive.exec.scratchdir</name>
<value>/tmp/hive</value>
</property>


<property>
<name>hive.metastore.local</name>
<value>false</value>
</property>


<property>
<name>hive.metastore.warehouse.dir</name>
<value>hdfs://z1:8899/user/hive/warehouse</value>
</property>

<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:oracle:thin:@//z4:1521/xe</value>
</property>
 
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.oracle.jdbc.Driver</value>
</property>
 
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>hive</value>
</property>
 
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>hive</value>
</property>
 

<property>
    <name>hive.querylog.location</name>
    <value>$HIVE_HOME/iotmp</value>
    <description>Location of Hive run time structured log file</description>
  </property>

  <property>
    <name>hive.exec.local.scratchdir</name>
    <value>$HIVE_HOME/iotmp</value>
    <description>Local scratch space for Hive jobs</description>
  </property>

  <property>
    <name>hive.downloaded.resources.dir</name>
    <value>$HIVE_HOME/iotmp</value>
    <description>Temporary local directory for added resources in the remote file system.</description>
  </property>


</configuration>
  

    On Monday, April 4, 2016 11:46 AM, Mich Talebzadeh <mi...@gmail.com> wrote:
 

 Interesting why you did not download Hive 2.0 which is out now
The error says:
 HiveConf of name hive.metastore.local does not exist
In you hive-site.xml how have you configured parameters for hive.metastore?
HTH

Dr Mich Talebzadeh LinkedIn  https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw http://talebzadehmich.wordpress.com 
On 4 April 2016 at 18:25, Raj Hadoop <ha...@yahoo.com> wrote:

Hi,
I have downloaded apache hive 1.1.1 and trying to setup hive environment in my hadoop cluster.
On one of the nodes i installed hive and when i set all the variables and environment i am getting the following error.Please advise.

[hadoop@z1 bin]$ hive
2016-04-04 10:12:45,686 WARN  [main] conf.HiveConf (HiveConf.java:initialize(2605)) - HiveConf of name hive.metastore.local does not exist

Logging initialized using configuration in jar:file:/home/hadoop/hive/hive111/lib/hive-common-1.1.1.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/hadoop/hadoop262/hadoop262/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hadoop/hive/hive111/lib/hive-jdbc-1.1.1-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
    at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:472)
    at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671)
    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:615)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
    at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1485)
    at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:64)
    at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:74)
    at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2841)
    at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2860)
    at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:453)
    ... 8 more
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
    at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1483)
    ... 13 more
Caused by: javax.jdo.JDOFatalInternalException: Error creating transactional connection factory
NestedThrowables:
java.lang.reflect.InvocationTargetException
    at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:587)
    at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:78


Regards,Raj





   

   



  

Re: Unable to start Hive CLI after install

Posted by Mich Talebzadeh <mi...@gmail.com>.
HI Raj,

Hive 2 is as good to go :) Check this
<https://www.linkedin.com/pulse/apache-hive-2-now-released-mich-talebzadeh-ph-d-?trk=prof-post>

I see that you are using Oracle DB as your metastore. Mine is Oracle as well

  <property>
    <name>javax.jdo.option.ConnectionURL</name>
    <value>jdbc:oracle:thin:@rhes564:1521:mydb</value>
    <description>JDBC connect string for a JDBC metastore</description>
  </property>

Also need username/password for your metastore

  <property>
    <name>javax.jdo.option.ConnectionUserName</name>
    <value>hiveuser</value>
    <description>Username to use against metastore database</description>
  </property>

  <property>
    <name>javax.jdo.option.ConnectionPassword</name>
    <value>xxxxxxx</value>
    <description>password to use against metastore database</description>
  </property>

Now you also need to put Oracle jar file ojdbc6.jar in $HIVE_HOME/lib otherwise
you won't be able to connect

HTH

Dr Mich Talebzadeh



LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*



http://talebzadehmich.wordpress.com



On 4 April 2016 at 20:02, Raj Hadoop <ha...@yahoo.com> wrote:

> Sorry in a typo with your name - Mich.
>
>
> On Monday, April 4, 2016 12:01 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>
> Thanks Mike. If Hive 2.0 is stable - i would definitely go for it. But let
> me troubleshoot 1.1.1 issues i am facing now.
>
> here is my hive-site.xml. Can you please let me know if i am missing
> anything.
>
> <property>
> <name>hive.exec.scratchdir</name>
> <value>/tmp/hive</value>
> </property>
>
>
> <property>
> <name>hive.metastore.local</name>
> <value>false</value>
> </property>
>
>
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value>hdfs://z1:8899/user/hive/warehouse</value>
> </property>
>
> <property>
> <name>javax.jdo.option.ConnectionURL</name>
> <value>jdbc:oracle:thin:@//z4:1521/xe</value>
> </property>
>
> <property>
> <name>javax.jdo.option.ConnectionDriverName</name>
> <value>com.oracle.jdbc.Driver</value>
> </property>
>
> <property>
> <name>javax.jdo.option.ConnectionUserName</name>
> <value>hive</value>
> </property>
>
> <property>
> <name>javax.jdo.option.ConnectionPassword</name>
> <value>hive</value>
> </property>
>
>
> <property>
>     <name>hive.querylog.location</name>
>     <value>$HIVE_HOME/iotmp</value>
>     <description>Location of Hive run time structured log
> file</description>
>   </property>
>
>   <property>
>     <name>hive.exec.local.scratchdir</name>
>     <value>$HIVE_HOME/iotmp</value>
>     <description>Local scratch space for Hive jobs</description>
>   </property>
>
>   <property>
>     <name>hive.downloaded.resources.dir</name>
>     <value>$HIVE_HOME/iotmp</value>
>     <description>Temporary local directory for added resources in the
> remote file system.</description>
>   </property>
>
>
> </configuration>
>
>
> On Monday, April 4, 2016 11:46 AM, Mich Talebzadeh <
> mich.talebzadeh@gmail.com> wrote:
>
>
> Interesting why you did not download Hive 2.0 which is out now
>
> The error says:
>
>  HiveConf of name hive.metastore.local does not exist
>
> In you hive-site.xml how have you configured parameters for hive.metastore?
>
> HTH
>
>
> Dr Mich Talebzadeh
>
> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>
> http://talebzadehmich.wordpress.com
>
>
> On 4 April 2016 at 18:25, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Hi,
>
> I have downloaded apache hive 1.1.1 and trying to setup hive environment
> in my hadoop cluster.
>
> On one of the nodes i installed hive and when i set all the variables and
> environment i am getting the following error.
> Please advise.
>
> [hadoop@z1 bin]$ hive
> 2016-04-04 10:12:45,686 WARN  [main] conf.HiveConf
> (HiveConf.java:initialize(2605)) - HiveConf of name hive.metastore.local
> does not exist
>
> Logging initialized using configuration in
> jar:file:/home/hadoop/hive/hive111/lib/hive-common-1.1.1.jar!/hive-log4j.properties
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/home/hadoop/hadoop262/hadoop262/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/home/hadoop/hive/hive111/lib/hive-jdbc-1.1.1-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> Exception in thread "main" java.lang.RuntimeException:
> java.lang.RuntimeException: Unable to instantiate
> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
>     at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:472)
>     at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671)
>     at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:615)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:606)
>     at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
> Caused by: java.lang.RuntimeException: Unable to instantiate
> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
>     at
> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1485)
>     at
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:64)
>     at
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:74)
>     at
> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2841)
>     at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2860)
>     at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:453)
>     ... 8 more
> Caused by: java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>     at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>     at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>     at
> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1483)
>     ... 13 more
> Caused by: javax.jdo.JDOFatalInternalException: Error creating
> transactional connection factory
> NestedThrowables:
> java.lang.reflect.InvocationTargetException
>     at
> org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:587)
>     at
> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:78
>
>
>
> Regards,
> Raj
>
>
>
>
>
>
>

Re: Unable to start Hive CLI after install

Posted by Raj Hadoop <ha...@yahoo.com>.
Sorry in a typo with your name - Mich.
 

    On Monday, April 4, 2016 12:01 PM, Raj Hadoop <ha...@yahoo.com> wrote:
 

 Thanks Mike. If Hive 2.0 is stable - i would definitely go for it. But let me troubleshoot 1.1.1 issues i am facing now.
here is my hive-site.xml. Can you please let me know if i am missing anything.

<property>
<name>hive.exec.scratchdir</name>
<value>/tmp/hive</value>
</property>


<property>
<name>hive.metastore.local</name>
<value>false</value>
</property>


<property>
<name>hive.metastore.warehouse.dir</name>
<value>hdfs://z1:8899/user/hive/warehouse</value>
</property>

<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:oracle:thin:@//z4:1521/xe</value>
</property>
 
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.oracle.jdbc.Driver</value>
</property>
 
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>hive</value>
</property>
 
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>hive</value>
</property>
 

<property>
    <name>hive.querylog.location</name>
    <value>$HIVE_HOME/iotmp</value>
    <description>Location of Hive run time structured log file</description>
  </property>

  <property>
    <name>hive.exec.local.scratchdir</name>
    <value>$HIVE_HOME/iotmp</value>
    <description>Local scratch space for Hive jobs</description>
  </property>

  <property>
    <name>hive.downloaded.resources.dir</name>
    <value>$HIVE_HOME/iotmp</value>
    <description>Temporary local directory for added resources in the remote file system.</description>
  </property>


</configuration>
  

    On Monday, April 4, 2016 11:46 AM, Mich Talebzadeh <mi...@gmail.com> wrote:
 

 Interesting why you did not download Hive 2.0 which is out now
The error says:
 HiveConf of name hive.metastore.local does not exist
In you hive-site.xml how have you configured parameters for hive.metastore?
HTH

Dr Mich Talebzadeh LinkedIn  https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw http://talebzadehmich.wordpress.com 
On 4 April 2016 at 18:25, Raj Hadoop <ha...@yahoo.com> wrote:

Hi,
I have downloaded apache hive 1.1.1 and trying to setup hive environment in my hadoop cluster.
On one of the nodes i installed hive and when i set all the variables and environment i am getting the following error.Please advise.

[hadoop@z1 bin]$ hive
2016-04-04 10:12:45,686 WARN  [main] conf.HiveConf (HiveConf.java:initialize(2605)) - HiveConf of name hive.metastore.local does not exist

Logging initialized using configuration in jar:file:/home/hadoop/hive/hive111/lib/hive-common-1.1.1.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/hadoop/hadoop262/hadoop262/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hadoop/hive/hive111/lib/hive-jdbc-1.1.1-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
    at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:472)
    at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671)
    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:615)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
    at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1485)
    at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:64)
    at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:74)
    at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2841)
    at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2860)
    at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:453)
    ... 8 more
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
    at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1483)
    ... 13 more
Caused by: javax.jdo.JDOFatalInternalException: Error creating transactional connection factory
NestedThrowables:
java.lang.reflect.InvocationTargetException
    at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:587)
    at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:78


Regards,Raj





   

  

Re: Unable to start Hive CLI after install

Posted by Raj Hadoop <ha...@yahoo.com>.
Thanks Mike. If Hive 2.0 is stable - i would definitely go for it. But let me troubleshoot 1.1.1 issues i am facing now.
here is my hive-site.xml. Can you please let me know if i am missing anything.

<property>
<name>hive.exec.scratchdir</name>
<value>/tmp/hive</value>
</property>


<property>
<name>hive.metastore.local</name>
<value>false</value>
</property>


<property>
<name>hive.metastore.warehouse.dir</name>
<value>hdfs://z1:8899/user/hive/warehouse</value>
</property>

<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:oracle:thin:@//z4:1521/xe</value>
</property>
 
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.oracle.jdbc.Driver</value>
</property>
 
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>hive</value>
</property>
 
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>hive</value>
</property>
 

<property>
    <name>hive.querylog.location</name>
    <value>$HIVE_HOME/iotmp</value>
    <description>Location of Hive run time structured log file</description>
  </property>

  <property>
    <name>hive.exec.local.scratchdir</name>
    <value>$HIVE_HOME/iotmp</value>
    <description>Local scratch space for Hive jobs</description>
  </property>

  <property>
    <name>hive.downloaded.resources.dir</name>
    <value>$HIVE_HOME/iotmp</value>
    <description>Temporary local directory for added resources in the remote file system.</description>
  </property>


</configuration>
  

    On Monday, April 4, 2016 11:46 AM, Mich Talebzadeh <mi...@gmail.com> wrote:
 

 Interesting why you did not download Hive 2.0 which is out now
The error says:
 HiveConf of name hive.metastore.local does not exist
In you hive-site.xml how have you configured parameters for hive.metastore?
HTH

Dr Mich Talebzadeh LinkedIn  https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw http://talebzadehmich.wordpress.com 
On 4 April 2016 at 18:25, Raj Hadoop <ha...@yahoo.com> wrote:

Hi,
I have downloaded apache hive 1.1.1 and trying to setup hive environment in my hadoop cluster.
On one of the nodes i installed hive and when i set all the variables and environment i am getting the following error.Please advise.

[hadoop@z1 bin]$ hive
2016-04-04 10:12:45,686 WARN  [main] conf.HiveConf (HiveConf.java:initialize(2605)) - HiveConf of name hive.metastore.local does not exist

Logging initialized using configuration in jar:file:/home/hadoop/hive/hive111/lib/hive-common-1.1.1.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/hadoop/hadoop262/hadoop262/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hadoop/hive/hive111/lib/hive-jdbc-1.1.1-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
    at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:472)
    at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671)
    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:615)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
    at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1485)
    at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:64)
    at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:74)
    at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2841)
    at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2860)
    at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:453)
    ... 8 more
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
    at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1483)
    ... 13 more
Caused by: javax.jdo.JDOFatalInternalException: Error creating transactional connection factory
NestedThrowables:
java.lang.reflect.InvocationTargetException
    at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:587)
    at org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:78


Regards,Raj





  

Re: Unable to start Hive CLI after install

Posted by Mich Talebzadeh <mi...@gmail.com>.
Interesting why you did not download Hive 2.0 which is out now

The error says:

 HiveConf of name hive.metastore.local does not exist

In you hive-site.xml how have you configured parameters for hive.metastore?

HTH


Dr Mich Talebzadeh



LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*



http://talebzadehmich.wordpress.com



On 4 April 2016 at 18:25, Raj Hadoop <ha...@yahoo.com> wrote:

> Hi,
>
> I have downloaded apache hive 1.1.1 and trying to setup hive environment
> in my hadoop cluster.
>
> On one of the nodes i installed hive and when i set all the variables and
> environment i am getting the following error.
> Please advise.
>
> [hadoop@z1 bin]$ hive
> 2016-04-04 10:12:45,686 WARN  [main] conf.HiveConf
> (HiveConf.java:initialize(2605)) - HiveConf of name hive.metastore.local
> does not exist
>
> Logging initialized using configuration in
> jar:file:/home/hadoop/hive/hive111/lib/hive-common-1.1.1.jar!/hive-log4j.properties
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/home/hadoop/hadoop262/hadoop262/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/home/hadoop/hive/hive111/lib/hive-jdbc-1.1.1-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> Exception in thread "main" java.lang.RuntimeException:
> java.lang.RuntimeException: Unable to instantiate
> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
>     at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:472)
>     at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671)
>     at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:615)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:606)
>     at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
> Caused by: java.lang.RuntimeException: Unable to instantiate
> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
>     at
> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1485)
>     at
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:64)
>     at
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:74)
>     at
> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2841)
>     at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2860)
>     at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:453)
>     ... 8 more
> Caused by: java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>     at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>     at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>     at
> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1483)
>     ... 13 more
> Caused by: javax.jdo.JDOFatalInternalException: Error creating
> transactional connection factory
> NestedThrowables:
> java.lang.reflect.InvocationTargetException
>     at
> org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:587)
>     at
> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:78
>
>
>
> Regards,
> Raj
>
>