You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by "Dilli Arumugam (JIRA)" <ji...@apache.org> on 2014/11/18 19:34:34 UTC

[jira] [Created] (AMBARI-8374) creating cluster failed with zookeeper installation failure

Dilli Arumugam created AMBARI-8374:
--------------------------------------

             Summary: creating cluster failed with zookeeper installation failure
                 Key: AMBARI-8374
                 URL: https://issues.apache.org/jira/browse/AMBARI-8374
             Project: Ambari
          Issue Type: Bug
          Components: ambari-agent
    Affects Versions: 2.0.0
            Reporter: Dilli Arumugam
             Fix For: 2.0.0


Attempting to create HDP 2.2 cluster with Ambari trunk build as of 11/17/14.
Cluster creation failed with zookeeper server and client failing to install.

Failure output:

2014-11-18 18:10:04,553 - Error while executing command 'install':
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 152, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_server.py", line 31, in install
    self.configure(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_server.py", line 35, in configure
    zookeeper(type='server')
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper.py", line 61, in zookeeper
    group=params.user_group
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 119, in __new__
    env.resources[r_type][name] = obj
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/config_dictionary.py", line 79, in __getattr__
    raise Fail("Configuration parameter '"+self.name+"' was not found in configurations dictionary!")
Fail: Configuration parameter 'dataDir' was not found in configurations dictionary!
stdout:   /var/lib/ambari-agent/data/output-119.txt

2014-11-18 18:10:02,622 - Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/;     curl -kf -x "" --retry 10     http://c6401.ambari.apache.org:8080/resources//UnlimitedJCEPolicyJDK7.zip -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip'] {'environment': ..., 'not_if': 'test -e /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip', 'ignore_failures': True, 'path': ['/bin', '/usr/bin/']}
2014-11-18 18:10:02,632 - Skipping Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/;     curl -kf -x "" --retry 10     http://c6401.ambari.apache.org:8080/resources//UnlimitedJCEPolicyJDK7.zip -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip'] due to not_if
2014-11-18 18:10:02,633 - Group['hadoop'] {'ignore_failures': False}
2014-11-18 18:10:02,634 - Modifying group hadoop
2014-11-18 18:10:02,651 - Group['nobody'] {'ignore_failures': False}
2014-11-18 18:10:02,651 - Modifying group nobody
2014-11-18 18:10:02,667 - Group['users'] {'ignore_failures': False}
2014-11-18 18:10:02,668 - Modifying group users
2014-11-18 18:10:02,685 - Group['knox'] {'ignore_failures': False}
2014-11-18 18:10:02,686 - Modifying group knox
2014-11-18 18:10:02,699 - User['nobody'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'nobody']}
2014-11-18 18:10:02,700 - Modifying user nobody
2014-11-18 18:10:02,715 - User['oozie'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'users']}
2014-11-18 18:10:02,716 - Modifying user oozie
2014-11-18 18:10:02,732 - User['hive'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-18 18:10:02,733 - Modifying user hive
2014-11-18 18:10:02,750 - User['mapred'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-18 18:10:02,751 - Modifying user mapred
2014-11-18 18:10:02,768 - User['hbase'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-18 18:10:02,769 - Modifying user hbase
2014-11-18 18:10:02,782 - User['ambari-qa'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'users']}
2014-11-18 18:10:02,783 - Modifying user ambari-qa
2014-11-18 18:10:02,801 - User['zookeeper'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-18 18:10:02,802 - Modifying user zookeeper
2014-11-18 18:10:02,818 - User['tez'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'users']}
2014-11-18 18:10:02,818 - Modifying user tez
2014-11-18 18:10:02,834 - User['hdfs'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-18 18:10:02,834 - Modifying user hdfs
2014-11-18 18:10:02,852 - User['knox'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-18 18:10:02,853 - Modifying user knox
2014-11-18 18:10:02,872 - User['yarn'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-18 18:10:02,873 - Modifying user yarn
2014-11-18 18:10:02,887 - User['hcat'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-18 18:10:02,887 - Modifying user hcat
2014-11-18 18:10:02,901 - File['/var/lib/ambari-agent/data/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2014-11-18 18:10:02,902 - Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 2>/dev/null'] {'not_if': 'test $(id -u ambari-qa) -gt 1000'}
2014-11-18 18:10:02,918 - Skipping Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 2>/dev/null'] due to not_if
2014-11-18 18:10:02,919 - File['/var/lib/ambari-agent/data/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2014-11-18 18:10:02,919 - Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/hadoop/hbase 2>/dev/null'] {'not_if': 'test $(id -u hbase) -gt 1000'}
2014-11-18 18:10:02,931 - Skipping Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/hadoop/hbase 2>/dev/null'] due to not_if
2014-11-18 18:10:02,931 - Directory['/etc/hadoop/conf.empty'] {'owner': 'root', 'group': 'root', 'recursive': True}
2014-11-18 18:10:02,932 - Link['/etc/hadoop/conf'] {'not_if': 'ls /etc/hadoop/conf', 'to': '/etc/hadoop/conf.empty'}
2014-11-18 18:10:02,950 - Skipping Link['/etc/hadoop/conf'] due to not_if
2014-11-18 18:10:02,963 - File['/etc/hadoop/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs'}
2014-11-18 18:10:02,980 - Repository['HDP-2.2'] {'base_url': 'http://s3.amazonaws.com/dev.hortonworks.com/HDP/centos6/2.x/BUILDS/2.2.0.0-2037', 'action': ['create'], 'components': [u'HDP', 'main'], 'repo_template': 'repo_suse_rhel.j2', 'repo_file_name': 'HDP', 'mirror_list': None}
2014-11-18 18:10:02,988 - File['/etc/yum.repos.d/HDP.repo'] {'content': Template('repo_suse_rhel.j2')}
2014-11-18 18:10:02,989 - Repository['HDP-UTILS-1.1.0.20'] {'base_url': 'http://s3.amazonaws.com/dev.hortonworks.com/HDP-UTILS-1.1.0.20/repos/centos6', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': 'repo_suse_rhel.j2', 'repo_file_name': 'HDP-UTILS', 'mirror_list': None}
2014-11-18 18:10:02,993 - File['/etc/yum.repos.d/HDP-UTILS.repo'] {'content': Template('repo_suse_rhel.j2')}
2014-11-18 18:10:02,994 - Package['unzip'] {}
2014-11-18 18:10:03,324 - Skipping installing existent package unzip
2014-11-18 18:10:03,325 - Package['curl'] {}
2014-11-18 18:10:03,707 - Skipping installing existent package curl
2014-11-18 18:10:03,707 - Package['hdp-select'] {}
2014-11-18 18:10:04,033 - Skipping installing existent package hdp-select
2014-11-18 18:10:04,034 - Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/ ;   curl -kf -x ""   --retry 10 http://c6401.ambari.apache.org:8080/resources//jdk-7u67-linux-x64.tar.gz -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz'] {'environment': ..., 'not_if': 'test -e /usr/jdk64/jdk1.7.0_67/bin/java', 'path': ['/bin', '/usr/bin/']}
2014-11-18 18:10:04,046 - Skipping Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/ ;   curl -kf -x ""   --retry 10 http://c6401.ambari.apache.org:8080/resources//jdk-7u67-linux-x64.tar.gz -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz'] due to not_if
2014-11-18 18:10:04,047 - Execute['mkdir -p /usr/jdk64 ; cd /usr/jdk64 ; tar -xf /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz > /dev/null 2>&1'] {'not_if': 'test -e /usr/jdk64/jdk1.7.0_67/bin/java', 'path': ['/bin', '/usr/bin/']}
2014-11-18 18:10:04,059 - Skipping Execute['mkdir -p /usr/jdk64 ; cd /usr/jdk64 ; tar -xf /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz > /dev/null 2>&1'] due to not_if
2014-11-18 18:10:04,176 - Package['zookeeper_2_2_*'] {}
2014-11-18 18:10:04,525 - Skipping installing existent package zookeeper_2_2_*
2014-11-18 18:10:04,529 - Directory['/etc/zookeeper/conf'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
2014-11-18 18:10:04,541 - File['/etc/zookeeper/conf/zookeeper-env.sh'] {'owner': 'zookeeper', 'content': InlineTemplate(...), 'group': 'hadoop'}
2014-11-18 18:10:04,550 - File['/etc/zookeeper/conf/zoo.cfg'] {'owner': 'zookeeper', 'content': Template('zoo.cfg.j2'), 'group': 'hadoop'}
2014-11-18 18:10:04,552 - File['/etc/zookeeper/conf/configuration.xsl'] {'owner': 'zookeeper', 'content': Template('configuration.xsl.j2'), 'group': 'hadoop'}
2014-11-18 18:10:04,553 - Directory['/var/run/zookeeper'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
2014-11-18 18:10:04,553 - Directory['/var/log/zookeeper'] {'owner': 'zookeeper', 'group': 'hadoop', 'recursive': True}
2014-11-18 18:10:04,553 - Error while executing command 'install':
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 152, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_server.py", line 31, in install
    self.configure(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper_server.py", line 35, in configure
    zookeeper(type='server')
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/ZOOKEEPER/package/scripts/zookeeper.py", line 61, in zookeeper
    group=params.user_group
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 119, in __new__
    env.resources[r_type][name] = obj
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/config_dictionary.py", line 79, in __getattr__
    raise Fail("Configuration parameter '"+self.name+"' was not found in configurations dictionary!")
Fail: Configuration parameter 'dataDir' was not found in configurations dictionary!




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)