[jira] [Created] (AMBARI-9821) Need to update HIVE_AUX_JARS_PATH in hive-env.sh

["Dmitry Lysnichenko (JIRA)" <ji...@apache.org>]

Dmitry Lysnichenko created AMBARI-9821:
------------------------------------------

             Summary: Need to update HIVE_AUX_JARS_PATH in hive-env.sh
                 Key: AMBARI-9821
                 URL: https://issues.apache.org/jira/browse/AMBARI-9821
             Project: Ambari
          Issue Type: Bug
          Components: ambari-server
    Affects Versions: 1.7.0
            Reporter: Dmitry Lysnichenko
            Assignee: Dmitry Lysnichenko
             Fix For: 2.0.0


 Hivecli fails to start after upgrade of HDP 2.1 to HDP 2.2.
{code}
After upgrading to HDP 2.2, hive fails to start with the following errors:
> hive 
15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.optimize.mapjoin.mapreduce does not exist 
15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.heapsize does not exist 
15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.metastore.direct.sql.batch.size does not exist 
15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.server2.enable.impersonation does not exist 
15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.semantic.analyzer.factory.impl does not exist 
15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.auto.convert.sortmerge.join.noconditionaltask does not exist
Logging initialized using configuration in file:/etc/hive/conf/hive-log4j.properties 
SLF4J: Class path contains multiple SLF4J bindings. 
SLF4J: Found binding in jar:file:/usr/hdp/2.2.0.0-2041/hadoop/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class 
SLF4J: Found binding in jar:file:/usr/hdp/2.2.0.0-2041/hive/lib/hive-jdbc-0.14.0.2.2.0.0-2041-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class 
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 
SLF4J: Actual binding is of type org.slf4j.impl.Log4jLoggerFactory

Exception in thread "main" java.lang.RuntimeException: java.io.IOException: Previous writer likely failed to write hdfs://host1:8020/tmp/hive/v800493/_tez_session_dir/e40df1ce-d258-4a14-844f-d6c39b2d60cf/hive-hcatalog-core-*.jar. Failing because I am unlikely to write too. Exception in thread "main" java.lang.RuntimeException: java.io.IOException: Previous writer likely failed to write hdfs://host1:8020/tmp/hive/v800493/_tez_session_dir/e40df1ce-d258-4a14-844f-d6c39b2d60cf/hive-hcatalog-core-*.jar. Failing because I am unlikely to write too. 
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:457) 
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:672) 
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616) 
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
at java.lang.reflect.Method.invoke(Method.java:606) 
at org.apache.hadoop.util.RunJar.run(RunJar.java:221) 
at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 
Caused by: java.io.IOException: Previous writer likely failed to write hdfs://host1:8020/tmp/hive/v800493/_tez_session_dir/e40df1ce-d258-4a14-844f-d6c39b2d60cf/hive-hcatalog-core-*.jar. Failing because I am unlikely to write too. Caused by: java.io.IOException: Previous writer likely failed to write hdfs://host1:8020/tmp/hive/v800493/_tez_session_dir/e40df1ce-d258-4a14-844f-d6c39b2d60cf/hive-hcatalog-core-*.jar. Failing because I am unlikely to write too. 
at org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeResource(DagUtils.java:983) 
at org.apache.hadoop.hive.ql.exec.tez.DagUtils.addTempResources(DagUtils.java:857) 
at org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeTempFilesFromConf(DagUtils.java:800) 
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.refreshLocalResourcesFromConf(TezSessionState.java:228) 
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:154) 
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:122) 
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:454) 

{code}

unable to access the hivecli. also unable to perform hive queries using Tez.

WORK AROUND:
In the hive-env.sh
Folder containing extra libraries required for hive compilation/execution can be controlled by:
if [ "$ {HIVE_AUX_JARS_PATH}" != "" ]; then 
export HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH}

elif [ -d "/usr/hdp/current/hive-webhcat/share/hcatalog" ]; then 
export HIVE_AUX_JARS_PATH=/usr/hdp/current/hive-webhcat/share/hcatalog 
fi



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)