[jira] [Comment Edited] (AMBARI-23943) Hiveserver2 fails to start on viewFS enabled cluster: {hive_server2_zookeeper_namespace} is not ready yet

["Andrew Onischuk (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AMBARI-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16490351#comment-16490351 ] 

Andrew Onischuk edited comment on AMBARI-23943 at 5/25/18 7:40 AM:
-------------------------------------------------------------------

[~jonathan.hurley] that commit required a second commit to hdp_amari_def
So I wanted to commit it one by one. (otherwise CI won't take it)  No need to revert
I will commit it once again. After it's complete it needs HDP-3.0 change to work properly.


was (Author: aonishuk):
[~jonathan.hurley] that commit required a second commit to hdp_amari_def
So I wanted to commit it one by one.  No need to revert
I will commit it once again. After it's complete it needs HDP-3.0 change to work properly.

> Hiveserver2 fails to start on viewFS enabled cluster: {hive_server2_zookeeper_namespace} is not ready yet
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: AMBARI-23943
>                 URL: https://issues.apache.org/jira/browse/AMBARI-23943
>             Project: Ambari
>          Issue Type: Bug
>            Reporter: Andrew Onischuk
>            Assignee: Andrew Onischuk
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 2.7.0
>
>         Attachments: AMBARI-23943.patch, AMBARI-23943.patch, AMBARI-23943.patch
>
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>
>   * Tried to deploy a cluster with viewFS enabled via blueprint
>   * HiveServer2 is failing to start with below error 
>     
>         
>     Traceback (most recent call last):
>       File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/HIVE/package/scripts/hive_server.py", line 137, in 
>         HiveServer().execute()
>       File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 353, in execute
>         method(env)
>       File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/HIVE/package/scripts/hive_server.py", line 53, in start
>         hive_service('hiveserver2', action = 'start', upgrade_type=upgrade_type)
>       File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/HIVE/package/scripts/hive_service.py", line 102, in hive_service
>         wait_for_znode()
>       File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/decorator.py", line 62, in wrapper
>         return function(*args, **kwargs)
>       File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/HIVE/package/scripts/hive_service.py", line 191, in wait_for_znode
>         raise Fail(format("ZooKeeper node /{hive_server2_zookeeper_namespace} is not ready yet"))
>     resource_management.core.exceptions.Fail: ZooKeeper node /hiveserver2 is not ready yet
>     
> out log has a reference to hdfs:// Filesystem
>     
>         
>     2018-05-17 23:54:17,398 - Skipping fs root check as fs_root does not start with hdfs://
>     2018-05-17 23:54:17,399 - Execute['/var/lib/ambari-agent/tmp/start_hiveserver2_script /grid/0/log/hive/hive-server2.out /grid/0/log/hive/hive-server2.err /var/run/hive/hive-server.pid /usr/hdp/current/hive-server2/conf/ /grid/0/log/hive'] {'environment': {'HIVE_BIN': 'hive', 'JAVA_HOME': u'/usr/lib/jvm/java-openjdk', 'HADOOP_HOME': u'/usr/hdp/current/hadoop-client'}, 'not_if': 'ls /var/run/hive/hive-server.pid >/dev/null 2>&1 && ps -p  >/dev/null 2>&1', 'user': 'hive', 'path': [u'/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent:/usr/hdp/current/hive-server2/bin:/usr/hdp/3.0.0.0-1345/hadoop/bin']}
>     2018-05-17 23:54:17,507 - Execute['/usr/lib/jvm/java-openjdk/bin/java -cp /usr/lib/ambari-agent/DBConnectionVerification.jar:/usr/hdp/current/hive-server2/lib/mysql-connector-java.jar org.apache.ambari.server.DBConnectionVerification 'jdbc:mysql://ctr-e138-1518143905142-317960-01-000006.hwx.site/hivedb?createDatabaseIfNotExist=true' hiveuser [PROTECTED] com.mysql.jdbc.Driver'] {'path': ['/usr/sbin:/sbin:/usr/local/bin:/bin:/usr/bin'], 'tries': 5, 'try_sleep': 10}
>     2018-05-17 23:54:18,156 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server ctr-e138-1518143905142-317960-01-000005.hwx.site:2181,ctr-e138-1518143905142-317960-01-000006.hwx.site:2181,ctr-e138-1518143905142-317960-01-000007.hwx.site:2181 ls /hiveserver2 | grep '\[serverUri=''] {}
>     2018-05-17 23:54:19,032 - call returned (1, 'Node does not exist: /hiveserver2')
>     2018-05-17 23:54:19,033 - Will retry 29 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 5 sec(s)
>     2018-05-17 23:54:24,038 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server ctr-e138-1518143905142-317960-01-000005.hwx.site:2181,ctr-e138-1518143905142-317960-01-000006.hwx.site:2181,ctr-e138-1518143905142-317960-01-000007.hwx.site:2181 ls /hiveserver2 | grep '\[serverUri=''] {}
>     2018-05-17 23:54:24,842 - call returned (1, 'Node does not exist: /hiveserver2')
>     



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)