centos 6 + ambari 2.0 + hdp 2.2 == timeout

[Greg Hill <gr...@RACKSPACE.COM>]

I can't get an install to work on ambari 2.0 + hdp 2.2 using the public yum repos.  It just times out after 1800s on a yum install every time.  Are hortonworks repos being super slow or is something else screwy happening?

My repos were defaulted by Ambari to:

http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.2.4.2
http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.20/repos/centos6

I was able to log in to the node and install the package manually just fine.  Maybe the repos were just down earlier today?  I seriously hope a default install doesn't take more than 30 minutes now :D

Greg
stderr:   /var/lib/ambari-agent/data/errors-29.txt

Python script has been killed due to timeout after waiting 1800 secs

stdout:   /var/lib/ambari-agent/data/output-29.txt

2015-05-04 20:32:54,008 - u"Directory['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts/']" {'recursive': True}
2015-05-04 20:32:54,072 - Creating directory u"Directory['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts/']"
2015-05-04 20:32:54,258 - u"File['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip']" {'content': DownloadSource('http://c6401.ambari.apache.org:8080/resources//UnlimitedJCEPolicyJDK7.zip')}
2015-05-04 20:32:54,346 - Downloading the file from http://c6401.ambari.apache.org:8080/resources//UnlimitedJCEPolicyJDK7.zip
2015-05-04 20:32:54,407 - Writing u"File['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip']" because it doesn't exist
2015-05-04 20:32:54,548 - u"Group['hadoop']" {'ignore_failures': False}
2015-05-04 20:32:54,550 - Adding group u"Group['hadoop']"
2015-05-04 20:32:54,594 - u"Group['nobody']" {'ignore_failures': False}
2015-05-04 20:32:54,595 - Modifying group nobody
2015-05-04 20:32:54,638 - u"Group['users']" {'ignore_failures': False}
2015-05-04 20:32:54,639 - Modifying group users
2015-05-04 20:32:54,683 - u"User['nobody']" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'nobody']}
2015-05-04 20:32:54,683 - Modifying user nobody
2015-05-04 20:32:54,727 - u"User['hive']" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2015-05-04 20:32:54,728 - Adding user u"User['hive']"
2015-05-04 20:32:54,811 - u"User['mapred']" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2015-05-04 20:32:54,812 - Adding user u"User['mapred']"
2015-05-04 20:32:54,855 - u"User['ambari-qa']" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'users']}
2015-05-04 20:32:54,856 - Adding user u"User['ambari-qa']"
2015-05-04 20:32:54,899 - u"User['zookeeper']" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2015-05-04 20:32:54,899 - Adding user u"User['zookeeper']"
2015-05-04 20:32:54,942 - u"User['tez']" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'users']}
2015-05-04 20:32:54,943 - Adding user u"User['tez']"
2015-05-04 20:32:54,987 - u"User['hdfs']" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2015-05-04 20:32:54,988 - Adding user u"User['hdfs']"
2015-05-04 20:32:55,031 - u"User['yarn']" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2015-05-04 20:32:55,031 - Adding user u"User['yarn']"
2015-05-04 20:32:55,075 - u"User['hcat']" {'gid': 'hadoop', 'ignore_failures': False, 'groups': [u'hadoop']}
2015-05-04 20:32:55,076 - Adding user u"User['hcat']"
2015-05-04 20:32:55,120 - u"File['/var/lib/ambari-agent/data/tmp/changeUid.sh']" {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2015-05-04 20:32:55,293 - Writing u"File['/var/lib/ambari-agent/data/tmp/changeUid.sh']" because it doesn't exist
2015-05-04 20:32:55,436 - Changing permission for /var/lib/ambari-agent/data/tmp/changeUid.sh from 644 to 555
2015-05-04 20:32:55,479 - u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa']" {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2015-05-04 20:32:55,603 - u"Group['hdfs']" {'ignore_failures': False}
2015-05-04 20:32:55,603 - Adding group u"Group['hdfs']"
2015-05-04 20:32:55,648 - u"User['hdfs']" {'ignore_failures': False, 'groups': [u'hadoop', u'hdfs']}
2015-05-04 20:32:55,648 - Modifying user hdfs
2015-05-04 20:32:55,692 - u"Directory['/etc/hadoop']" {'mode': 0755}
2015-05-04 20:32:55,736 - Creating directory u"Directory['/etc/hadoop']"
2015-05-04 20:32:55,962 - u"Directory['/etc/hadoop/conf.empty']" {'owner': 'root', 'group': 'hadoop', 'recursive': True}
2015-05-04 20:32:56,006 - Creating directory u"Directory['/etc/hadoop/conf.empty']"
2015-05-04 20:32:56,191 - Changing group for /etc/hadoop/conf.empty from 0 to hadoop
2015-05-04 20:32:56,235 - u"Link['/etc/hadoop/conf']" {'not_if': 'ls /etc/hadoop/conf', 'to': '/etc/hadoop/conf.empty'}
2015-05-04 20:32:56,368 - Creating symbolic u"Link['/etc/hadoop/conf']"
2015-05-04 20:32:56,422 - u"File['/etc/hadoop/conf/hadoop-env.sh']" {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2015-05-04 20:32:56,552 - Writing u"File['/etc/hadoop/conf/hadoop-env.sh']" because it doesn't exist
2015-05-04 20:32:56,695 - Changing owner for /etc/hadoop/conf/hadoop-env.sh from 0 to hdfs
2015-05-04 20:32:56,739 - Changing group for /etc/hadoop/conf/hadoop-env.sh from 0 to hadoop
2015-05-04 20:32:56,798 - u"Repository['HDP-2.2']" {'base_url': 'http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.2.4.2', 'action': ['create'], 'components': [u'HDP', 'main'], 'repo_template': 'repo_suse_rhel.j2', 'repo_file_name': 'HDP', 'mirror_list': None}
2015-05-04 20:32:56,806 - u"File['/etc/yum.repos.d/HDP.repo']" {'content': Template('repo_suse_rhel.j2')}
2015-05-04 20:32:56,955 - Writing u"File['/etc/yum.repos.d/HDP.repo']" because it doesn't exist
2015-05-04 20:32:57,097 - u"Repository['HDP-UTILS-1.1.0.20']" {'base_url': 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.20/repos/centos6', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': 'repo_suse_rhel.j2', 'repo_file_name': 'HDP-UTILS', 'mirror_list': None}
2015-05-04 20:32:57,101 - u"File['/etc/yum.repos.d/HDP-UTILS.repo']" {'content': Template('repo_suse_rhel.j2')}
2015-05-04 20:32:57,231 - Writing u"File['/etc/yum.repos.d/HDP-UTILS.repo']" because it doesn't exist
2015-05-04 20:32:57,379 - u"Package['unzip']" {}
2015-05-04 20:32:57,587 - Installing package unzip ('/usr/bin/yum -d 0 -e 0 -y install unzip')
2015-05-04 20:32:58,643 - u"Package['curl']" {}
2015-05-04 20:32:58,850 - Skipping installing existent package curl
2015-05-04 20:32:58,850 - u"Package['hdp-select']" {}
2015-05-04 20:32:59,055 - Installing package hdp-select ('/usr/bin/yum -d 0 -e 0 -y install hdp-select')
2015-05-04 20:32:59,828 - u"Directory['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts/']" {'recursive': True}
2015-05-04 20:32:59,973 - u"File['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz']" {'content': DownloadSource('http://c6401.ambari.apache.org:8080/resources//jdk-7u67-linux-x64.tar.gz')}
2015-05-04 20:33:00,062 - Downloading the file from http://c6401.ambari.apache.org:8080/resources//jdk-7u67-linux-x64.tar.gz
2015-05-04 20:33:17,456 - Writing u"File['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz']" because it doesn't exist
2015-05-04 20:33:18,347 - u"Directory['/usr/jdk64']" {}
2015-05-04 20:33:18,391 - Creating directory u"Directory['/usr/jdk64']"
2015-05-04 20:33:18,622 - u"Execute['('chmod', 'a+x', u'/usr/jdk64')']" {'not_if': 'test -e /usr/jdk64/jdk1.7.0_67/bin/java', 'sudo': True}
2015-05-04 20:33:18,709 - u"Execute['mkdir -p /var/lib/ambari-agent/data/tmp/jdk && cd /var/lib/ambari-agent/data/tmp/jdk && tar -xf /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz && ambari-sudo.sh cp -rp /var/lib/ambari-agent/data/tmp/jdk/* /usr/jdk64']" {'not_if': 'test -e /usr/jdk64/jdk1.7.0_67/bin/java'}
2015-05-04 20:33:24,390 - u"Execute['('chgrp', '-R', u'hadoop', u'/usr/jdk64/jdk1.7.0_67')']" {'sudo': True}
2015-05-04 20:33:24,434 - u"Execute['('chown', '-R', 'root', u'/usr/jdk64/jdk1.7.0_67')']" {'sudo': True}
2015-05-04 20:33:25,115 - u"Package['hadoop_2_2_*']" {}
2015-05-04 20:33:25,342 - Installing package hadoop_2_2_* ('/usr/bin/yum -d 0 -e 0 -y install 'hadoop_2_2_*'')