You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by "Andrew Onischuk (JIRA)" <ji...@apache.org> on 2014/11/04 01:29:33 UTC
[jira] [Created] (AMBARI-8132) On Ubuntu HostCleanup doesn't remove
all packages on HDP-2.2
Andrew Onischuk created AMBARI-8132:
---------------------------------------
Summary: On Ubuntu HostCleanup doesn't remove all packages on HDP-2.2
Key: AMBARI-8132
URL: https://issues.apache.org/jira/browse/AMBARI-8132
Project: Ambari
Issue Type: Bug
Reporter: Andrew Onischuk
Assignee: Andrew Onischuk
Fix For: 1.7.0
Deploy cluster.
Perform host cleanup (stop services, reset ambari, register hosts, run
HostCleanup.py)
Deploy cluster again with all same configs.
Error appears on deployment:
2014-11-03 13:41:46,720 - Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/; curl -kf -x "" --retry 10 http://ip-172-31-37-144.ec2.internal:8080/resources//UnlimitedJCEPolicyJDK7.zip -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip'] {'environment': ..., 'not_if': 'test -e /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip', 'ignore_failures': True, 'path': ['/bin', '/usr/bin/']}
2014-11-03 13:41:46,769 - Skipping Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/; curl -kf -x "" --retry 10 http://ip-172-31-37-144.ec2.internal:8080/resources//UnlimitedJCEPolicyJDK7.zip -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip'] due to not_if
2014-11-03 13:41:46,770 - Group['hadoop'] {'ignore_failures': False}
2014-11-03 13:41:46,773 - Modifying group hadoop
2014-11-03 13:41:46,851 - Group['nobody'] {'ignore_failures': False}
2014-11-03 13:41:46,851 - Modifying group nobody
2014-11-03 13:41:46,910 - Group['users'] {'ignore_failures': False}
2014-11-03 13:41:46,915 - Modifying group users
2014-11-03 13:41:46,947 - Group['nagios'] {'ignore_failures': False}
2014-11-03 13:41:46,948 - Modifying group nagios
2014-11-03 13:41:46,978 - Group['knox'] {'ignore_failures': False}
2014-11-03 13:41:46,979 - Modifying group knox
2014-11-03 13:41:47,010 - User['hive'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-03 13:41:47,011 - Modifying user hive
2014-11-03 13:41:47,042 - User['oozie'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'users']}
2014-11-03 13:41:47,043 - Modifying user oozie
2014-11-03 13:41:47,071 - User['nobody'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'nobody']}
2014-11-03 13:41:47,072 - Modifying user nobody
2014-11-03 13:41:47,100 - User['nagios'] {'gid': 'nagios', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-03 13:41:47,101 - Modifying user nagios
2014-11-03 13:41:47,126 - User['ambari-qa'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'users']}
2014-11-03 13:41:47,127 - Modifying user ambari-qa
2014-11-03 13:41:47,149 - User['flume'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-03 13:41:47,150 - Modifying user flume
2014-11-03 13:41:47,173 - User['hdfs'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-03 13:41:47,174 - Modifying user hdfs
2014-11-03 13:41:47,202 - User['knox'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-03 13:41:47,203 - Modifying user knox
2014-11-03 13:41:47,227 - User['storm'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-03 13:41:47,228 - Modifying user storm
2014-11-03 13:41:47,254 - User['mapred'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-03 13:41:47,255 - Modifying user mapred
2014-11-03 13:41:47,283 - User['hbase'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-03 13:41:47,284 - Modifying user hbase
2014-11-03 13:41:47,307 - User['tez'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'users']}
2014-11-03 13:41:47,308 - Modifying user tez
2014-11-03 13:41:47,332 - User['zookeeper'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-03 13:41:47,333 - Modifying user zookeeper
2014-11-03 13:41:47,356 - User['falcon'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-03 13:41:47,357 - Modifying user falcon
2014-11-03 13:41:47,382 - User['sqoop'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-03 13:41:47,383 - Modifying user sqoop
2014-11-03 13:41:47,408 - User['yarn'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-03 13:41:47,409 - Modifying user yarn
2014-11-03 13:41:47,432 - User['hcat'] {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2014-11-03 13:41:47,433 - Modifying user hcat
2014-11-03 13:41:47,459 - File['/var/lib/ambari-agent/data/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2014-11-03 13:41:47,461 - Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 2>/dev/null'] {'not_if': 'test $(id -u ambari-qa) -gt 1000'}
2014-11-03 13:41:47,487 - Skipping Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 2>/dev/null'] due to not_if
2014-11-03 13:41:47,488 - File['/var/lib/ambari-agent/data/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2014-11-03 13:41:47,489 - Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/mnt/hadoop/hbase 2>/dev/null'] {'not_if': 'test $(id -u hbase) -gt 1000'}
2014-11-03 13:41:47,513 - Skipping Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/mnt/hadoop/hbase 2>/dev/null'] due to not_if
2014-11-03 13:41:47,513 - Directory['/etc/hadoop/conf.empty'] {'owner': 'root', 'group': 'root', 'recursive': True}
2014-11-03 13:41:47,514 - Link['/etc/hadoop/conf'] {'not_if': 'ls /etc/hadoop/conf', 'to': '/etc/hadoop/conf.empty'}
2014-11-03 13:41:47,534 - Skipping Link['/etc/hadoop/conf'] due to not_if
2014-11-03 13:41:47,554 - File['/etc/hadoop/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs'}
2014-11-03 13:41:47,573 - Repository['HDP-2.2'] {'base_url': 'http://s3.amazonaws.com/dev.hortonworks.com/HDP/ubuntu12/2.x/BUILDS/2.2.0.0-1717', 'action': ['create'], 'components': [u'HDP', 'main'], 'repo_template': 'repo_ubuntu.j2', 'repo_file_name': 'HDP', 'mirror_list': None}
2014-11-03 13:41:47,585 - File['/tmp/tmpNs5CN6'] {'content': Template('repo_ubuntu.j2')}
2014-11-03 13:41:47,586 - Writing File['/tmp/tmpNs5CN6'] because contents don't match
2014-11-03 13:41:47,587 - Repository['HDP-UTILS-1.1.0.20'] {'base_url': 'http://s3.amazonaws.com/dev.hortonworks.com/HDP-UTILS-1.1.0.20/repos/ubuntu12', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': 'repo_ubuntu.j2', 'repo_file_name': 'HDP-UTILS', 'mirror_list': None}
2014-11-03 13:41:47,589 - File['/tmp/tmpiCPfLD'] {'content': Template('repo_ubuntu.j2')}
2014-11-03 13:41:47,590 - Writing File['/tmp/tmpiCPfLD'] because contents don't match
2014-11-03 13:41:47,590 - Package['unzip'] {}
2014-11-03 13:41:47,647 - Installing package unzip ('DEBIAN_FRONTEND=noninteractive /usr/bin/apt-get -q -o Dpkg::Options::='--force-confdef' --allow-unauthenticated --assume-yes install unzip ; ps aux > /var/log/apt_failure.out')
2014-11-03 13:41:48,414 - Package['curl'] {}
2014-11-03 13:41:48,481 - Installing package curl ('DEBIAN_FRONTEND=noninteractive /usr/bin/apt-get -q -o Dpkg::Options::='--force-confdef' --allow-unauthenticated --assume-yes install curl ; ps aux > /var/log/apt_failure.out')
2014-11-03 13:41:49,420 - Package['hdp-select'] {}
2014-11-03 13:41:49,472 - Installing package hdp-select ('DEBIAN_FRONTEND=noninteractive /usr/bin/apt-get -q -o Dpkg::Options::='--force-confdef' --allow-unauthenticated --assume-yes install hdp-select ; ps aux > /var/log/apt_failure.out')
2014-11-03 13:41:50,255 - Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/ ; curl -kf -x "" --retry 10 http://ip-172-31-37-144.ec2.internal:8080/resources//jdk-7u67-linux-x64.tar.gz -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz'] {'environment': ..., 'not_if': 'test -e /usr/jdk64/jdk1.7.0_67/bin/java', 'path': ['/bin', '/usr/bin/']}
2014-11-03 13:41:50,278 - Skipping Execute['mkdir -p /var/lib/ambari-agent/data/tmp/AMBARI-artifacts/ ; curl -kf -x "" --retry 10 http://ip-172-31-37-144.ec2.internal:8080/resources//jdk-7u67-linux-x64.tar.gz -o /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz'] due to not_if
2014-11-03 13:41:50,280 - Execute['mkdir -p /usr/jdk64 ; cd /usr/jdk64 ; tar -xf /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz > /dev/null 2>&1'] {'not_if': 'test -e /usr/jdk64/jdk1.7.0_67/bin/java', 'path': ['/bin', '/usr/bin/']}
2014-11-03 13:41:50,302 - Skipping Execute['mkdir -p /usr/jdk64 ; cd /usr/jdk64 ; tar -xf /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz > /dev/null 2>&1'] due to not_if
2014-11-03 13:41:50,553 - Package['falcon-2-2-.*'] {}
2014-11-03 13:41:50,608 - Skipping installing existent package falcon-2-2-.*
2014-11-03 13:41:50,612 - Directory['/var/run/falcon'] {'owner': 'falcon'}
2014-11-03 13:41:50,614 - Directory['/grid/0/log/falcon'] {'owner': 'falcon', 'recursive': True}
2014-11-03 13:41:50,615 - Directory['/usr/hdp/current/falcon-client/webapp'] {'owner': 'falcon'}
2014-11-03 13:41:50,615 - Creating directory Directory['/usr/hdp/current/falcon-client/webapp']
2014-11-03 13:41:50,615 - Error while executing command 'install':
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
method(env)
File "/var/lib/ambari-agent/cache/stacks/HDP/2.1/services/FALCON/package/scripts/falcon_client.py", line 26, in install
self.configure(env)
File "/var/lib/ambari-agent/cache/stacks/HDP/2.1/services/FALCON/package/scripts/falcon_client.py", line 32, in configure
falcon('client', action='config')
File "/var/lib/ambari-agent/cache/stacks/HDP/2.1/services/FALCON/package/scripts/falcon.py", line 33, in falcon
owner=params.falcon_user
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 152, in action_create
raise Fail("Applying %s failed, parent directory %s doesn't exist" % (self.resource, dirname))
Fail: Applying Directory['/usr/hdp/current/falcon-client/webapp'] failed, parent directory /usr/hdp/current/falcon-client doesn't exist
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)