You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by "Hudson (JIRA)" <ji...@apache.org> on 2015/02/26 21:49:04 UTC

[jira] [Commented] (AMBARI-9821) Need to update HIVE_AUX_JARS_PATH in hive-env.sh

    [ https://issues.apache.org/jira/browse/AMBARI-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339136#comment-14339136 ] 

Hudson commented on AMBARI-9821:
--------------------------------

SUCCESS: Integrated in Ambari-trunk-Commit #1879 (See [https://builds.apache.org/job/Ambari-trunk-Commit/1879/])
AMBARI-9821. Need to update HIVE_AUX_JARS_PATH in hive-env.sh (dlysnichenko) (dlysnichenko: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=f76de1329035395841300335e37257ea63e20f9c)
* ambari-server/src/main/resources/stacks/HDP/2.2/services/HIVE/configuration/hive-env.xml


> Need to update HIVE_AUX_JARS_PATH in hive-env.sh
> ------------------------------------------------
>
>                 Key: AMBARI-9821
>                 URL: https://issues.apache.org/jira/browse/AMBARI-9821
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-server
>    Affects Versions: 1.7.0
>            Reporter: Dmitry Lysnichenko
>            Assignee: Dmitry Lysnichenko
>             Fix For: 2.0.0
>
>
>  Hivecli fails to start after upgrade of HDP 2.1 to HDP 2.2.
> {code}
> After upgrading to HDP 2.2, hive fails to start with the following errors:
> > hive 
> 15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.optimize.mapjoin.mapreduce does not exist 
> 15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.heapsize does not exist 
> 15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.metastore.direct.sql.batch.size does not exist 
> 15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.server2.enable.impersonation does not exist 
> 15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.semantic.analyzer.factory.impl does not exist 
> 15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.auto.convert.sortmerge.join.noconditionaltask does not exist
> Logging initialized using configuration in file:/etc/hive/conf/hive-log4j.properties 
> SLF4J: Class path contains multiple SLF4J bindings. 
> SLF4J: Found binding in jar:file:/usr/hdp/2.2.0.0-2041/hadoop/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class 
> SLF4J: Found binding in jar:file:/usr/hdp/2.2.0.0-2041/hive/lib/hive-jdbc-0.14.0.2.2.0.0-2041-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class 
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 
> SLF4J: Actual binding is of type org.slf4j.impl.Log4jLoggerFactory
> Exception in thread "main" java.lang.RuntimeException: java.io.IOException: Previous writer likely failed to write hdfs://host1:8020/tmp/hive/v800493/_tez_session_dir/e40df1ce-d258-4a14-844f-d6c39b2d60cf/hive-hcatalog-core-*.jar. Failing because I am unlikely to write too. Exception in thread "main" java.lang.RuntimeException: java.io.IOException: Previous writer likely failed to write hdfs://host1:8020/tmp/hive/v800493/_tez_session_dir/e40df1ce-d258-4a14-844f-d6c39b2d60cf/hive-hcatalog-core-*.jar. Failing because I am unlikely to write too. 
> at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:457) 
> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:672) 
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616) 
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
> at java.lang.reflect.Method.invoke(Method.java:606) 
> at org.apache.hadoop.util.RunJar.run(RunJar.java:221) 
> at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 
> Caused by: java.io.IOException: Previous writer likely failed to write hdfs://host1:8020/tmp/hive/v800493/_tez_session_dir/e40df1ce-d258-4a14-844f-d6c39b2d60cf/hive-hcatalog-core-*.jar. Failing because I am unlikely to write too. Caused by: java.io.IOException: Previous writer likely failed to write hdfs://host1:8020/tmp/hive/v800493/_tez_session_dir/e40df1ce-d258-4a14-844f-d6c39b2d60cf/hive-hcatalog-core-*.jar. Failing because I am unlikely to write too. 
> at org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeResource(DagUtils.java:983) 
> at org.apache.hadoop.hive.ql.exec.tez.DagUtils.addTempResources(DagUtils.java:857) 
> at org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeTempFilesFromConf(DagUtils.java:800) 
> at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.refreshLocalResourcesFromConf(TezSessionState.java:228) 
> at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:154) 
> at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:122) 
> at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:454) 
> {code}
> unable to access the hivecli. also unable to perform hive queries using Tez.
> WORK AROUND:
> In the hive-env.sh
> Folder containing extra libraries required for hive compilation/execution can be controlled by:
> if [ "$ {HIVE_AUX_JARS_PATH}" != "" ]; then 
> export HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH}
> elif [ -d "/usr/hdp/current/hive-webhcat/share/hcatalog" ]; then 
> export HIVE_AUX_JARS_PATH=/usr/hdp/current/hive-webhcat/share/hcatalog 
> fi



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)