You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ambari.apache.org by on 2014/05/29 11:33:03 UTC
Unable to add new hosts to Hadoop cluster using Ambari (Repo not reachable)
I have a 60 node cluster setup using Amabri a month ago. Today when i
attempt to add a new host, i see the following error.
My hosts have internet connection and hence i do not use local repo option.
What do i need to change to fix it ?
This URL seem to be dead now (
http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/repodata/repomd.xml
).
Host Config:
[dvasthimal@historical-11-320640 druid-services-0.6.109-SNAPSHOT]$ uname -a
Linux historical-11-320640 2.6.32-279.22.1.el6.x86_64 #1 SMP Sun Jan 13
09:21:40 EST 2013 x86_64 x86_64 x86_64 GNU/Linux
[dvasthimal@historical-11-320640 druid-services-0.6.109-SNAPSHOT]$ cat
/etc/redhat-release
Red Hat Enterprise Linux Server release 6.3 (Santiago)
[dvasthimal@historical-11-320640 druid-services-0.6.109-SNAPSHOT]$
==========================
Copying common functions script...
==========================
scp /usr/lib/python2.6/site-packages/common_functions
host=historical-11-320640.slc01.dev.ebayc3.com, exitcode=0
==========================
Copying OS type check script...
==========================
scp /usr/lib/python2.6/site-packages/ambari_server/os_check_type.py
host=historical-11-320640.slc01.dev.ebayc3.com, exitcode=0
==========================
Running OS type check...
==========================
Cluster primary/cluster OS type is redhat6 and local/current OS type is
redhat6
Connection to historical-11-320640.slc01.dev.ebayc3.com closed.
SSH command execution finished
host=historical-11-320640.slc01.dev.ebayc3.com, exitcode=0
==========================
Checking 'sudo' package on remote host...
==========================
sudo-1.7.4p5-13.el6_3.x86_64
Connection to historical-11-320640.slc01.dev.ebayc3.com closed.
SSH command execution finished
host=historical-11-320640.slc01.dev.ebayc3.com, exitcode=0
==========================
Copying repo file to 'tmp' folder...
==========================
scp /etc/yum.repos.d/ambari.repo
host=historical-11-320640.slc01.dev.ebayc3.com, exitcode=0
==========================
Moving file to repo dir...
==========================
Connection to historical-11-320640.slc01.dev.ebayc3.com closed.
SSH command execution finished
host=historical-11-320640.slc01.dev.ebayc3.com, exitcode=0
==========================
Copying setup script file...
==========================
scp /usr/lib/python2.6/site-packages/ambari_server/setupAgent.py
host=historical-11-320640.slc01.dev.ebayc3.com, exitcode=0
==========================
Running setup agent script...
==========================
http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/repodata/repomd.xml:
[Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404"
Trying other mirror.
Error: Cannot retrieve repository metadata (repomd.xml) for repository:
Updates-ambari-1.x. Please verify its path and try again
http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/repodata/repomd.xml:
[Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404"
Trying other mirror.
Error: Cannot retrieve repository metadata (repomd.xml) for repository:
Updates-ambari-1.x. Please verify its path and try again
{'exitstatus': 1, 'log': ('', None)}
Connection to historical-11-320640.slc01.dev.ebayc3.com closed.
SSH command execution finished
host=historical-11-320640.slc01.dev.ebayc3.com, exitcode=1
ERROR: Bootstrap of host historical-11-320640.slc01.dev.ebayc3.com fails
because previous action finished with non-zero exit code (1)
ERROR MESSAGE: tcgetattr: Invalid argument
Connection to historical-11-320640.slc01.dev.ebayc3.com closed.
STDOUT:
http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/repodata/repomd.xml:
[Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404"
Trying other mirror.
Error: Cannot retrieve repository metadata (repomd.xml) for repository:
Updates-ambari-1.x. Please verify its path and try again
http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/repodata/repomd.xml:
[Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404"
Trying other mirror.
Error: Cannot retrieve repository metadata (repomd.xml) for repository:
Updates-ambari-1.x. Please verify its path and try again
{'exitstatus': 1, 'log': ('', None)}
Connection to historical-11-320640.slc01.dev.ebayc3.com closed.
====
More details
[root@ambariserver-272825 yum.repos.d]# ls
ambari.repo ebay-rhel-repo.repo redhat.repo rhel-source.repo
[root@ambariserver-272825 yum.repos.d]# cat ambari.repo
[ambari-1.x]
name=Ambari 1.x
baseurl=http://public-repo-1.hortonworks.com/ambari/centos6/1.x/GA
gpgcheck=1
gpgkey=
http://public-repo-1.hortonworks.com/ambari/centos6/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
[HDP-UTILS-1.1.0.16]
name=Hortonworks Data Platform Utils Version - HDP-UTILS-1.1.0.16
baseurl=
http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.16/repos/centos6
gpgcheck=0
gpgkey=
http://public-repo-1.hortonworks.com/ambari/centos6/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
[Updates-ambari-1.x]
name=ambari-1.x - Updates
baseurl=http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates
gpgcheck=1
gpgkey=
http://public-repo-1.hortonworks.com/ambari/centos6/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
[root@ambariserver-272825 yum.repos.d]# cat ebay-rhel-repo.repo
[ebay-rhel-repo]
name=eBay Red Hat Enterprise Linux $releasever - $basearch
baseurl=http://installsvc.vip/images/redhat/6.3_64/
enabled=1
gpgcheck=0
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release
priority=1
[root@ambariserver-272825 yum.repos.d]# cat redhat.repo
#
# Certificate-Based Repositories
# Managed by (rhsm) subscription-manager
#
# If this file is empty and this system is subscribed consider
# a "yum repolist" to refresh available repos
#
[root@ambariserver-272825 yum.repos.d]# cat rhel-source.repo
[rhel-source]
name=Red Hat Enterprise Linux $releasever - $basearch - Source
baseurl=
ftp://ftp.redhat.com/pub/redhat/linux/enterprise/$releasever/en/os/SRPMS/
enabled=0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release
[rhel-source-beta]
name=Red Hat Enterprise Linux $releasever Beta - $basearch - Source
baseurl=ftp://ftp.redhat.com/pub/redhat/linux/beta/$releasever/en/os/SRPMS/
enabled=0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-beta,file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release
[root@ambariserver-272825 yum.repos.d]#
--
Deepak
--
Deepak
Re: Unable to add new hosts to Hadoop cluster using Ambari (Repo not reachable)
Posted by .
This repo http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/
went dead on me. Fixed it as
http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/1.5.1
Fix:
[Updates-ambari-1.x]
name=ambari-1.x - Updates
baseurl=
http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/1.5.1
gpgcheck=1
gpgkey=
http://public-repo-1.hortonworks.com/ambari/centos6/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
On Thu, May 29, 2014 at 3:03 PM, ÐΞ€ρ@Ҝ (๏̯͡๏) <de...@gmail.com> wrote:
> I have a 60 node cluster setup using Amabri a month ago. Today when i
> attempt to add a new host, i see the following error.
> My hosts have internet connection and hence i do not use local repo option.
>
> What do i need to change to fix it ?
>
> This URL seem to be dead now (
> http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/repodata/repomd.xml
> ).
>
> Host Config:
>
> [dvasthimal@historical-11-320640 druid-services-0.6.109-SNAPSHOT]$ uname
> -a
>
> Linux historical-11-320640 2.6.32-279.22.1.el6.x86_64 #1 SMP Sun Jan 13
> 09:21:40 EST 2013 x86_64 x86_64 x86_64 GNU/Linux
>
> [dvasthimal@historical-11-320640 druid-services-0.6.109-SNAPSHOT]$ cat
> /etc/redhat-release
>
> Red Hat Enterprise Linux Server release 6.3 (Santiago)
>
> [dvasthimal@historical-11-320640 druid-services-0.6.109-SNAPSHOT]$
>
>
>
>
> ==========================
> Copying common functions script...
> ==========================
>
> scp /usr/lib/python2.6/site-packages/common_functions
> host=historical-11-320640.slc01.dev.ebayc3.com, exitcode=0
>
> ==========================
> Copying OS type check script...
> ==========================
>
> scp /usr/lib/python2.6/site-packages/ambari_server/os_check_type.py
> host=historical-11-320640.slc01.dev.ebayc3.com, exitcode=0
>
> ==========================
> Running OS type check...
> ==========================
> Cluster primary/cluster OS type is redhat6 and local/current OS type is
> redhat6
>
> Connection to historical-11-320640.slc01.dev.ebayc3.com closed.
> SSH command execution finished
> host=historical-11-320640.slc01.dev.ebayc3.com, exitcode=0
>
> ==========================
> Checking 'sudo' package on remote host...
> ==========================
> sudo-1.7.4p5-13.el6_3.x86_64
>
> Connection to historical-11-320640.slc01.dev.ebayc3.com closed.
> SSH command execution finished
> host=historical-11-320640.slc01.dev.ebayc3.com, exitcode=0
>
> ==========================
> Copying repo file to 'tmp' folder...
> ==========================
>
> scp /etc/yum.repos.d/ambari.repo
> host=historical-11-320640.slc01.dev.ebayc3.com, exitcode=0
>
> ==========================
> Moving file to repo dir...
> ==========================
>
> Connection to historical-11-320640.slc01.dev.ebayc3.com closed.
> SSH command execution finished
> host=historical-11-320640.slc01.dev.ebayc3.com, exitcode=0
>
> ==========================
> Copying setup script file...
> ==========================
>
> scp /usr/lib/python2.6/site-packages/ambari_server/setupAgent.py
> host=historical-11-320640.slc01.dev.ebayc3.com, exitcode=0
>
> ==========================
> Running setup agent script...
> ==========================
>
> http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/repodata/repomd.xml:
> [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404"
> Trying other mirror.
> Error: Cannot retrieve repository metadata (repomd.xml) for repository:
> Updates-ambari-1.x. Please verify its path and try again
>
> http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/repodata/repomd.xml:
> [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404"
> Trying other mirror.
> Error: Cannot retrieve repository metadata (repomd.xml) for repository:
> Updates-ambari-1.x. Please verify its path and try again
> {'exitstatus': 1, 'log': ('', None)}
>
> Connection to historical-11-320640.slc01.dev.ebayc3.com closed.
> SSH command execution finished
> host=historical-11-320640.slc01.dev.ebayc3.com, exitcode=1
>
> ERROR: Bootstrap of host historical-11-320640.slc01.dev.ebayc3.com fails
> because previous action finished with non-zero exit code (1)
> ERROR MESSAGE: tcgetattr: Invalid argument
> Connection to historical-11-320640.slc01.dev.ebayc3.com closed.
>
> STDOUT:
> http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/repodata/repomd.xml:
> [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404"
> Trying other mirror.
> Error: Cannot retrieve repository metadata (repomd.xml) for repository:
> Updates-ambari-1.x. Please verify its path and try again
>
> http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/repodata/repomd.xml:
> [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404"
> Trying other mirror.
> Error: Cannot retrieve repository metadata (repomd.xml) for repository:
> Updates-ambari-1.x. Please verify its path and try again
> {'exitstatus': 1, 'log': ('', None)}
>
> Connection to historical-11-320640.slc01.dev.ebayc3.com closed.
>
> ====
>
>
>
> More details
>
> [root@ambariserver-272825 yum.repos.d]# ls
>
> ambari.repo ebay-rhel-repo.repo redhat.repo rhel-source.repo
>
> [root@ambariserver-272825 yum.repos.d]# cat ambari.repo
>
> [ambari-1.x]
>
> name=Ambari 1.x
>
> baseurl=http://public-repo-1.hortonworks.com/ambari/centos6/1.x/GA
>
> gpgcheck=1
>
> gpgkey=
> http://public-repo-1.hortonworks.com/ambari/centos6/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
>
> enabled=1
>
> priority=1
>
>
> [HDP-UTILS-1.1.0.16]
>
> name=Hortonworks Data Platform Utils Version - HDP-UTILS-1.1.0.16
>
> baseurl=
> http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.16/repos/centos6
>
> gpgcheck=0
>
> gpgkey=
> http://public-repo-1.hortonworks.com/ambari/centos6/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
>
> enabled=1
>
> priority=1
>
>
> [Updates-ambari-1.x]
>
> name=ambari-1.x - Updates
>
> baseurl=http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates
>
> gpgcheck=1
>
> gpgkey=
> http://public-repo-1.hortonworks.com/ambari/centos6/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
>
> enabled=1
>
> priority=1
>
> [root@ambariserver-272825 yum.repos.d]# cat ebay-rhel-repo.repo
>
> [ebay-rhel-repo]
>
> name=eBay Red Hat Enterprise Linux $releasever - $basearch
>
> baseurl=http://installsvc.vip/images/redhat/6.3_64/
>
> enabled=1
>
> gpgcheck=0
>
> gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release
>
> priority=1
>
> [root@ambariserver-272825 yum.repos.d]# cat redhat.repo
>
> #
>
> # Certificate-Based Repositories
>
> # Managed by (rhsm) subscription-manager
>
> #
>
> # If this file is empty and this system is subscribed consider
>
> # a "yum repolist" to refresh available repos
>
> #
>
>
> [root@ambariserver-272825 yum.repos.d]# cat rhel-source.repo
>
> [rhel-source]
>
> name=Red Hat Enterprise Linux $releasever - $basearch - Source
>
> baseurl=
> ftp://ftp.redhat.com/pub/redhat/linux/enterprise/$releasever/en/os/SRPMS/
>
> enabled=0
>
> gpgcheck=1
>
> gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release
>
>
> [rhel-source-beta]
>
> name=Red Hat Enterprise Linux $releasever Beta - $basearch - Source
>
> baseurl=
> ftp://ftp.redhat.com/pub/redhat/linux/beta/$releasever/en/os/SRPMS/
>
> enabled=0
>
> gpgcheck=1
>
>
> gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-beta,file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release
>
> [root@ambariserver-272825 yum.repos.d]#
>
> --
> Deepak
>
> --
> Deepak
>
>
--
Deepak