You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Dmytro Sen <ds...@hortonworks.com> on 2014/09/30 15:51:36 UTC

Review Request 26175: Unable to start Zookeeper with HDP-2.2

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26175/
-----------------------------------------------------------

Review request for Ambari and Vitalyi Brodetskyi.


Bugs: AMBARI-7557
    https://issues.apache.org/jira/browse/AMBARI-7557


Repository: ambari


Description
-------

it seems like we have some problem with zookeeper rpm in stack HDP-2.2
STR:
select only Zookeeper and Storm services to deploy
stderr: 
2014-09-27 08:50:35,436 - Error while executing command 'start':
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_server.py", line 41, in start
    zookeeper_service(action = 'start')
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_service.py", line 34, in zookeeper_service
    user=params.zk_user
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 237, in action_run
    raise ex
Fail: Execution of 'source /etc/zookeeper/conf/zookeeper-env.sh ; env ZOOCFGDIR=/etc/zookeeper/conf ZOOCFG=zoo.cfg /usr/lib/zookeeper/bin/zkServer.sh start' returned 127. env: /usr/lib/zookeeper/bin/zkServer.sh: No such file or directory
 stdout:
2014-09-27 08:50:34,739 - Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/;     curl -kf -x "" --retry 10     http://c6401.ambari.apache.org:8080/resources//UnlimitedJCEPolicyJDK7.zip -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip'] {'environment': ..., 'not_if': 'test -e /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip', 'ignore_failures': True, 'path': ['/bin', '/usr/bin/']}
2014-09-27 08:50:34,752 - Skipping Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/;     curl -kf -x "" --retry 10     http://c6401.ambari.apache.org:8080/resources//UnlimitedJCEPolicyJDK7.zip -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip'] due to not_if
2014-09-27 08:50:34,914 - Execute['/bin/echo 0 > /selinux/enforce'] {'only_if': 'test -f /selinux/enforce'}
2014-09-27 08:50:34,927 - Skipping Execute['/bin/echo 0 > /selinux/enforce'] due to only_if
2014-09-27 08:50:34,930 - Execute['mkdir -p /usr/lib/hadoop/lib/native/Linux-i386-32; ln -sf /usr/lib/libsnappy.so /usr/lib/hadoop/lib/native/Linux-i386-32/libsnappy.so'] {}
2014-09-27 08:50:34,950 - Execute['mkdir -p /usr/lib/hadoop/lib/native/Linux-amd64-64; ln -sf /usr/lib64/libsnappy.so /usr/lib/hadoop/lib/native/Linux-amd64-64/libsnappy.so'] {}
2014-09-27 08:50:35,125 - Directory['/etc/zookeeper/conf'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
2014-09-27 08:50:35,131 - File['/etc/zookeeper/conf/zookeeper-env.sh'] {'owner': 'zookeeper', 'content': InlineTemplate(...), 'group': 'hadoop'}
2014-09-27 08:50:35,141 - File['/etc/zookeeper/conf/zoo.cfg'] {'owner': 'zookeeper', 'content': Template('zoo.cfg.j2'), 'group': 'hadoop'}
2014-09-27 08:50:35,144 - File['/etc/zookeeper/conf/configuration.xsl'] {'owner': 'zookeeper', 'content': Template('configuration.xsl.j2'), 'group': 'hadoop'}
2014-09-27 08:50:35,144 - Directory['/var/run/zookeeper'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
2014-09-27 08:50:35,145 - Directory['/var/log/zookeeper'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
2014-09-27 08:50:35,145 - Directory['/hadoop/zookeeper'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
2014-09-27 08:50:35,146 - File['/hadoop/zookeeper/myid'] {'content': '1', 'mode': 0644}
2014-09-27 08:50:35,146 - File['/etc/zookeeper/conf/log4j.properties'] {'content': '...', 'owner': 'zookeeper', 'group': 'hadoop', 'mode': 0644}
2014-09-27 08:50:35,146 - File['/etc/zookeeper/conf/zoo_sample.cfg'] {'owner': 'zookeeper', 'group': 'hadoop'}
2014-09-27 08:50:35,148 - Execute['source /etc/zookeeper/conf/zookeeper-env.sh ; env ZOOCFGDIR=/etc/zookeeper/conf ZOOCFG=zoo.cfg /usr/lib/zookeeper/bin/zkServer.sh start'] {'not_if': 'ls /var/run/zookeeper/zookeeper_server.pid >/dev/null 2>&1 && ps `cat /var/run/zookeeper/zookeeper_server.pid` >/dev/null 2>&1', 'user': 'zookeeper'}
2014-09-27 08:50:35,436 - Error while executing command 'start':
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_server.py", line 41, in start
    zookeeper_service(action = 'start')
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_service.py", line 34, in zookeeper_service
    user=params.zk_user
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 237, in action_run
    raise ex
Fail: Execution of 'source /etc/zookeeper/conf/zookeeper-env.sh ; env ZOOCFGDIR=/etc/zookeeper/conf ZOOCFG=zoo.cfg /usr/lib/zookeeper/bin/zkServer.sh start' returned 127. env: /usr/lib/zookeeper/bin/zkServer.sh: No such file or directory


Diffs
-----

  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/hook.py cf83e19 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/params.py 7b94817 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/shared_initialization.py 4c633d2 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py d4ff0d3 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/FLUME/package/scripts/params.py 10389cd 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HBASE/package/scripts/params.py ed086dc 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HDFS/package/scripts/params.py c56fac4 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py e64ffa3 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/params.py 927c9e0 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/PIG/package/scripts/params.py 5d7ae16 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/SQOOP/package/scripts/params.py ff200b8 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/YARN/package/scripts/params.py 86eee78 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/params.py b691c3f 
  ambari-server/src/main/resources/stacks/HDP/2.1/services/FALCON/package/scripts/params.py 30548f1 
  ambari-server/src/main/resources/stacks/HDP/2.1/services/STORM/package/scripts/params.py 4a8ec51 
  ambari-server/src/main/resources/stacks/HDP/2.2/configuration/cluster-env.xml PRE-CREATION 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/HDFS/configuration/hadoop-env.xml 7370dd2 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/SLIDER/package/scripts/params.py 394ba12 
  ambari-web/app/data/HDP2/site_properties.js d176a92 

Diff: https://reviews.apache.org/r/26175/diff/


Testing
-------

manual deployment on HDP2.2 and HDP2.1


Thanks,

Dmytro Sen


Re: Review Request 26175: Unable to start Zookeeper with HDP-2.2

Posted by Vitalyi Brodetskyi <vb...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26175/#review54974
-----------------------------------------------------------

Ship it!


Ship It!

- Vitalyi Brodetskyi


On Вер. 30, 2014, 1:53 після полудня, Dmytro Sen wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/26175/
> -----------------------------------------------------------
> 
> (Updated Вер. 30, 2014, 1:53 після полудня)
> 
> 
> Review request for Ambari and Vitalyi Brodetskyi.
> 
> 
> Bugs: AMBARI-7557
>     https://issues.apache.org/jira/browse/AMBARI-7557
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> it seems like we have some problem with zookeeper rpm in stack HDP-2.2
> STR:
> select only Zookeeper and Storm services to deploy
> 
> 
> Logs:
> 
> stderr: 
> 2014-09-27 08:50:35,436 - Error while executing command 'start':
> Traceback (most recent call last):
>   File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
>     method(env)
>   File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_server.py", line 41, in start
>     zookeeper_service(action = 'start')
>   File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_service.py", line 34, in zookeeper_service
>     user=params.zk_user
>   File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
>     self.env.run()
>   File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
>     self.run_action(resource, action)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
>     provider_action()
>   File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 237, in action_run
>     raise ex
> Fail: Execution of 'source /etc/zookeeper/conf/zookeeper-env.sh ; env ZOOCFGDIR=/etc/zookeeper/conf ZOOCFG=zoo.cfg /usr/lib/zookeeper/bin/zkServer.sh start' returned 127. env: /usr/lib/zookeeper/bin/zkServer.sh: No such file or directory
>  stdout:
> 2014-09-27 08:50:34,739 - Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/;     curl -kf -x "" --retry 10     http://c6401.ambari.apache.org:8080/resources//UnlimitedJCEPolicyJDK7.zip -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip'] {'environment': ..., 'not_if': 'test -e /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip', 'ignore_failures': True, 'path': ['/bin', '/usr/bin/']}
> 2014-09-27 08:50:34,752 - Skipping Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/;     curl -kf -x "" --retry 10     http://c6401.ambari.apache.org:8080/resources//UnlimitedJCEPolicyJDK7.zip -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip'] due to not_if
> 2014-09-27 08:50:34,914 - Execute['/bin/echo 0 > /selinux/enforce'] {'only_if': 'test -f /selinux/enforce'}
> 2014-09-27 08:50:34,927 - Skipping Execute['/bin/echo 0 > /selinux/enforce'] due to only_if
> 2014-09-27 08:50:34,930 - Execute['mkdir -p /usr/lib/hadoop/lib/native/Linux-i386-32; ln -sf /usr/lib/libsnappy.so /usr/lib/hadoop/lib/native/Linux-i386-32/libsnappy.so'] {}
> 2014-09-27 08:50:34,950 - Execute['mkdir -p /usr/lib/hadoop/lib/native/Linux-amd64-64; ln -sf /usr/lib64/libsnappy.so /usr/lib/hadoop/lib/native/Linux-amd64-64/libsnappy.so'] {}
> 2014-09-27 08:50:35,125 - Directory['/etc/zookeeper/conf'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
> 2014-09-27 08:50:35,131 - File['/etc/zookeeper/conf/zookeeper-env.sh'] {'owner': 'zookeeper', 'content': InlineTemplate(...), 'group': 'hadoop'}
> 2014-09-27 08:50:35,141 - File['/etc/zookeeper/conf/zoo.cfg'] {'owner': 'zookeeper', 'content': Template('zoo.cfg.j2'), 'group': 'hadoop'}
> 2014-09-27 08:50:35,144 - File['/etc/zookeeper/conf/configuration.xsl'] {'owner': 'zookeeper', 'content': Template('configuration.xsl.j2'), 'group': 'hadoop'}
> 2014-09-27 08:50:35,144 - Directory['/var/run/zookeeper'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
> 2014-09-27 08:50:35,145 - Directory['/var/log/zookeeper'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
> 2014-09-27 08:50:35,145 - Directory['/hadoop/zookeeper'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
> 2014-09-27 08:50:35,146 - File['/hadoop/zookeeper/myid'] {'content': '1', 'mode': 0644}
> 2014-09-27 08:50:35,146 - File['/etc/zookeeper/conf/log4j.properties'] {'content': '...', 'owner': 'zookeeper', 'group': 'hadoop', 'mode': 0644}
> 2014-09-27 08:50:35,146 - File['/etc/zookeeper/conf/zoo_sample.cfg'] {'owner': 'zookeeper', 'group': 'hadoop'}
> 2014-09-27 08:50:35,148 - Execute['source /etc/zookeeper/conf/zookeeper-env.sh ; env ZOOCFGDIR=/etc/zookeeper/conf ZOOCFG=zoo.cfg /usr/lib/zookeeper/bin/zkServer.sh start'] {'not_if': 'ls /var/run/zookeeper/zookeeper_server.pid >/dev/null 2>&1 && ps `cat /var/run/zookeeper/zookeeper_server.pid` >/dev/null 2>&1', 'user': 'zookeeper'}
> 2014-09-27 08:50:35,436 - Error while executing command 'start':
> Traceback (most recent call last):
>   File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
>     method(env)
>   File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_server.py", line 41, in start
>     zookeeper_service(action = 'start')
>   File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_service.py", line 34, in zookeeper_service
>     user=params.zk_user
>   File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
>     self.env.run()
>   File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
>     self.run_action(resource, action)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
>     provider_action()
>   File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 237, in action_run
>     raise ex
> Fail: Execution of 'source /etc/zookeeper/conf/zookeeper-env.sh ; env ZOOCFGDIR=/etc/zookeeper/conf ZOOCFG=zoo.cfg /usr/lib/zookeeper/bin/zkServer.sh start' returned 127. env: /usr/lib/zookeeper/bin/zkServer.sh: No such file or directory
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/hook.py cf83e19 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/params.py 7b94817 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/shared_initialization.py 4c633d2 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py d4ff0d3 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/FLUME/package/scripts/params.py 10389cd 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HBASE/package/scripts/params.py ed086dc 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HDFS/package/scripts/params.py c56fac4 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py e64ffa3 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/params.py 927c9e0 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/PIG/package/scripts/params.py 5d7ae16 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/SQOOP/package/scripts/params.py ff200b8 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/YARN/package/scripts/params.py 86eee78 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/params.py b691c3f 
>   ambari-server/src/main/resources/stacks/HDP/2.1/services/FALCON/package/scripts/params.py 30548f1 
>   ambari-server/src/main/resources/stacks/HDP/2.1/services/STORM/package/scripts/params.py 4a8ec51 
>   ambari-server/src/main/resources/stacks/HDP/2.2/configuration/cluster-env.xml PRE-CREATION 
>   ambari-server/src/main/resources/stacks/HDP/2.2/services/HDFS/configuration/hadoop-env.xml 7370dd2 
>   ambari-server/src/main/resources/stacks/HDP/2.2/services/SLIDER/package/scripts/params.py 394ba12 
>   ambari-web/app/data/HDP2/site_properties.js d176a92 
> 
> Diff: https://reviews.apache.org/r/26175/diff/
> 
> 
> Testing
> -------
> 
> manual deployment on HDP2.2 and HDP2.1
> 
> 
> Thanks,
> 
> Dmytro Sen
> 
>


Re: Review Request 26175: Unable to start Zookeeper with HDP-2.2

Posted by Dmytro Sen <ds...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26175/
-----------------------------------------------------------

(Updated Сен. 30, 2014, 2:14 п.п.)


Review request for Ambari and Vitalyi Brodetskyi.


Bugs: AMBARI-7557
    https://issues.apache.org/jira/browse/AMBARI-7557


Repository: ambari


Description
-------

it seems like we have some problem with zookeeper rpm in stack HDP-2.2
STR:
select only Zookeeper and Storm services to deploy


Logs:

stderr: 
2014-09-27 08:50:35,436 - Error while executing command 'start':
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_server.py", line 41, in start
    zookeeper_service(action = 'start')
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_service.py", line 34, in zookeeper_service
    user=params.zk_user
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 237, in action_run
    raise ex
Fail: Execution of 'source /etc/zookeeper/conf/zookeeper-env.sh ; env ZOOCFGDIR=/etc/zookeeper/conf ZOOCFG=zoo.cfg /usr/lib/zookeeper/bin/zkServer.sh start' returned 127. env: /usr/lib/zookeeper/bin/zkServer.sh: No such file or directory
 stdout:
2014-09-27 08:50:34,739 - Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/;     curl -kf -x "" --retry 10     http://c6401.ambari.apache.org:8080/resources//UnlimitedJCEPolicyJDK7.zip -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip'] {'environment': ..., 'not_if': 'test -e /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip', 'ignore_failures': True, 'path': ['/bin', '/usr/bin/']}
2014-09-27 08:50:34,752 - Skipping Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/;     curl -kf -x "" --retry 10     http://c6401.ambari.apache.org:8080/resources//UnlimitedJCEPolicyJDK7.zip -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip'] due to not_if
2014-09-27 08:50:34,914 - Execute['/bin/echo 0 > /selinux/enforce'] {'only_if': 'test -f /selinux/enforce'}
2014-09-27 08:50:34,927 - Skipping Execute['/bin/echo 0 > /selinux/enforce'] due to only_if
2014-09-27 08:50:34,930 - Execute['mkdir -p /usr/lib/hadoop/lib/native/Linux-i386-32; ln -sf /usr/lib/libsnappy.so /usr/lib/hadoop/lib/native/Linux-i386-32/libsnappy.so'] {}
2014-09-27 08:50:34,950 - Execute['mkdir -p /usr/lib/hadoop/lib/native/Linux-amd64-64; ln -sf /usr/lib64/libsnappy.so /usr/lib/hadoop/lib/native/Linux-amd64-64/libsnappy.so'] {}
2014-09-27 08:50:35,125 - Directory['/etc/zookeeper/conf'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
2014-09-27 08:50:35,131 - File['/etc/zookeeper/conf/zookeeper-env.sh'] {'owner': 'zookeeper', 'content': InlineTemplate(...), 'group': 'hadoop'}
2014-09-27 08:50:35,141 - File['/etc/zookeeper/conf/zoo.cfg'] {'owner': 'zookeeper', 'content': Template('zoo.cfg.j2'), 'group': 'hadoop'}
2014-09-27 08:50:35,144 - File['/etc/zookeeper/conf/configuration.xsl'] {'owner': 'zookeeper', 'content': Template('configuration.xsl.j2'), 'group': 'hadoop'}
2014-09-27 08:50:35,144 - Directory['/var/run/zookeeper'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
2014-09-27 08:50:35,145 - Directory['/var/log/zookeeper'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
2014-09-27 08:50:35,145 - Directory['/hadoop/zookeeper'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
2014-09-27 08:50:35,146 - File['/hadoop/zookeeper/myid'] {'content': '1', 'mode': 0644}
2014-09-27 08:50:35,146 - File['/etc/zookeeper/conf/log4j.properties'] {'content': '...', 'owner': 'zookeeper', 'group': 'hadoop', 'mode': 0644}
2014-09-27 08:50:35,146 - File['/etc/zookeeper/conf/zoo_sample.cfg'] {'owner': 'zookeeper', 'group': 'hadoop'}
2014-09-27 08:50:35,148 - Execute['source /etc/zookeeper/conf/zookeeper-env.sh ; env ZOOCFGDIR=/etc/zookeeper/conf ZOOCFG=zoo.cfg /usr/lib/zookeeper/bin/zkServer.sh start'] {'not_if': 'ls /var/run/zookeeper/zookeeper_server.pid >/dev/null 2>&1 && ps `cat /var/run/zookeeper/zookeeper_server.pid` >/dev/null 2>&1', 'user': 'zookeeper'}
2014-09-27 08:50:35,436 - Error while executing command 'start':
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_server.py", line 41, in start
    zookeeper_service(action = 'start')
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_service.py", line 34, in zookeeper_service
    user=params.zk_user
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 237, in action_run
    raise ex
Fail: Execution of 'source /etc/zookeeper/conf/zookeeper-env.sh ; env ZOOCFGDIR=/etc/zookeeper/conf ZOOCFG=zoo.cfg /usr/lib/zookeeper/bin/zkServer.sh start' returned 127. env: /usr/lib/zookeeper/bin/zkServer.sh: No such file or directory


Diffs
-----

  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/hook.py cf83e19 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/params.py 7b94817 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/shared_initialization.py 4c633d2 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py d4ff0d3 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/FLUME/package/scripts/params.py 10389cd 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HBASE/package/scripts/params.py ed086dc 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HDFS/package/scripts/params.py c56fac4 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py e64ffa3 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/params.py 927c9e0 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/PIG/package/scripts/params.py 5d7ae16 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/SQOOP/package/scripts/params.py ff200b8 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/YARN/package/scripts/params.py 86eee78 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/params.py b691c3f 
  ambari-server/src/main/resources/stacks/HDP/2.1/services/FALCON/package/scripts/params.py 30548f1 
  ambari-server/src/main/resources/stacks/HDP/2.1/services/STORM/package/scripts/params.py 4a8ec51 
  ambari-server/src/main/resources/stacks/HDP/2.2/configuration/cluster-env.xml PRE-CREATION 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/HDFS/configuration/hadoop-env.xml 7370dd2 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/SLIDER/package/scripts/params.py 394ba12 
  ambari-web/app/data/HDP2/site_properties.js d176a92 

Diff: https://reviews.apache.org/r/26175/diff/


Testing (updated)
-------

manual deployment on HDP2.2 and HDP2.1

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Ambari Main ....................................... SUCCESS [6.535s]
[INFO] Apache Ambari Project POM ......................... SUCCESS [0.306s]
[INFO] Ambari Web ........................................ SUCCESS [42.753s]
[INFO] Ambari Views ...................................... SUCCESS [6.541s]
[INFO] Ambari Admin View ................................. SUCCESS [16.898s]
[INFO] Ambari Server ..................................... SUCCESS [20:56.297s]
[INFO] Ambari Agent ...................................... SUCCESS [9.722s]
[INFO] Ambari Client ..................................... SUCCESS [0.036s]
[INFO] Ambari Python Client .............................. SUCCESS [0.954s]
[INFO] Ambari Groovy Client .............................. SUCCESS [14.304s]
[INFO] Ambari Shell ...................................... SUCCESS [0.036s]
[INFO] Ambari Python Shell ............................... SUCCESS [0.044s]
[INFO] Ambari Groovy Shell ............................... SUCCESS [8.666s]


Thanks,

Dmytro Sen


Re: Review Request 26175: Unable to start Zookeeper with HDP-2.2

Posted by Dmytro Sen <ds...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26175/
-----------------------------------------------------------

(Updated Сен. 30, 2014, 1:53 п.п.)


Review request for Ambari and Vitalyi Brodetskyi.


Bugs: AMBARI-7557
    https://issues.apache.org/jira/browse/AMBARI-7557


Repository: ambari


Description (updated)
-------

it seems like we have some problem with zookeeper rpm in stack HDP-2.2
STR:
select only Zookeeper and Storm services to deploy


Logs:

stderr: 
2014-09-27 08:50:35,436 - Error while executing command 'start':
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_server.py", line 41, in start
    zookeeper_service(action = 'start')
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_service.py", line 34, in zookeeper_service
    user=params.zk_user
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 237, in action_run
    raise ex
Fail: Execution of 'source /etc/zookeeper/conf/zookeeper-env.sh ; env ZOOCFGDIR=/etc/zookeeper/conf ZOOCFG=zoo.cfg /usr/lib/zookeeper/bin/zkServer.sh start' returned 127. env: /usr/lib/zookeeper/bin/zkServer.sh: No such file or directory
 stdout:
2014-09-27 08:50:34,739 - Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/;     curl -kf -x "" --retry 10     http://c6401.ambari.apache.org:8080/resources//UnlimitedJCEPolicyJDK7.zip -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip'] {'environment': ..., 'not_if': 'test -e /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip', 'ignore_failures': True, 'path': ['/bin', '/usr/bin/']}
2014-09-27 08:50:34,752 - Skipping Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/;     curl -kf -x "" --retry 10     http://c6401.ambari.apache.org:8080/resources//UnlimitedJCEPolicyJDK7.zip -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip'] due to not_if
2014-09-27 08:50:34,914 - Execute['/bin/echo 0 > /selinux/enforce'] {'only_if': 'test -f /selinux/enforce'}
2014-09-27 08:50:34,927 - Skipping Execute['/bin/echo 0 > /selinux/enforce'] due to only_if
2014-09-27 08:50:34,930 - Execute['mkdir -p /usr/lib/hadoop/lib/native/Linux-i386-32; ln -sf /usr/lib/libsnappy.so /usr/lib/hadoop/lib/native/Linux-i386-32/libsnappy.so'] {}
2014-09-27 08:50:34,950 - Execute['mkdir -p /usr/lib/hadoop/lib/native/Linux-amd64-64; ln -sf /usr/lib64/libsnappy.so /usr/lib/hadoop/lib/native/Linux-amd64-64/libsnappy.so'] {}
2014-09-27 08:50:35,125 - Directory['/etc/zookeeper/conf'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
2014-09-27 08:50:35,131 - File['/etc/zookeeper/conf/zookeeper-env.sh'] {'owner': 'zookeeper', 'content': InlineTemplate(...), 'group': 'hadoop'}
2014-09-27 08:50:35,141 - File['/etc/zookeeper/conf/zoo.cfg'] {'owner': 'zookeeper', 'content': Template('zoo.cfg.j2'), 'group': 'hadoop'}
2014-09-27 08:50:35,144 - File['/etc/zookeeper/conf/configuration.xsl'] {'owner': 'zookeeper', 'content': Template('configuration.xsl.j2'), 'group': 'hadoop'}
2014-09-27 08:50:35,144 - Directory['/var/run/zookeeper'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
2014-09-27 08:50:35,145 - Directory['/var/log/zookeeper'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
2014-09-27 08:50:35,145 - Directory['/hadoop/zookeeper'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
2014-09-27 08:50:35,146 - File['/hadoop/zookeeper/myid'] {'content': '1', 'mode': 0644}
2014-09-27 08:50:35,146 - File['/etc/zookeeper/conf/log4j.properties'] {'content': '...', 'owner': 'zookeeper', 'group': 'hadoop', 'mode': 0644}
2014-09-27 08:50:35,146 - File['/etc/zookeeper/conf/zoo_sample.cfg'] {'owner': 'zookeeper', 'group': 'hadoop'}
2014-09-27 08:50:35,148 - Execute['source /etc/zookeeper/conf/zookeeper-env.sh ; env ZOOCFGDIR=/etc/zookeeper/conf ZOOCFG=zoo.cfg /usr/lib/zookeeper/bin/zkServer.sh start'] {'not_if': 'ls /var/run/zookeeper/zookeeper_server.pid >/dev/null 2>&1 && ps `cat /var/run/zookeeper/zookeeper_server.pid` >/dev/null 2>&1', 'user': 'zookeeper'}
2014-09-27 08:50:35,436 - Error while executing command 'start':
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_server.py", line 41, in start
    zookeeper_service(action = 'start')
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_service.py", line 34, in zookeeper_service
    user=params.zk_user
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 237, in action_run
    raise ex
Fail: Execution of 'source /etc/zookeeper/conf/zookeeper-env.sh ; env ZOOCFGDIR=/etc/zookeeper/conf ZOOCFG=zoo.cfg /usr/lib/zookeeper/bin/zkServer.sh start' returned 127. env: /usr/lib/zookeeper/bin/zkServer.sh: No such file or directory


Diffs
-----

  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/hook.py cf83e19 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/params.py 7b94817 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/shared_initialization.py 4c633d2 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py d4ff0d3 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/FLUME/package/scripts/params.py 10389cd 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HBASE/package/scripts/params.py ed086dc 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HDFS/package/scripts/params.py c56fac4 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py e64ffa3 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/params.py 927c9e0 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/PIG/package/scripts/params.py 5d7ae16 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/SQOOP/package/scripts/params.py ff200b8 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/YARN/package/scripts/params.py 86eee78 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/params.py b691c3f 
  ambari-server/src/main/resources/stacks/HDP/2.1/services/FALCON/package/scripts/params.py 30548f1 
  ambari-server/src/main/resources/stacks/HDP/2.1/services/STORM/package/scripts/params.py 4a8ec51 
  ambari-server/src/main/resources/stacks/HDP/2.2/configuration/cluster-env.xml PRE-CREATION 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/HDFS/configuration/hadoop-env.xml 7370dd2 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/SLIDER/package/scripts/params.py 394ba12 
  ambari-web/app/data/HDP2/site_properties.js d176a92 

Diff: https://reviews.apache.org/r/26175/diff/


Testing
-------

manual deployment on HDP2.2 and HDP2.1


Thanks,

Dmytro Sen