You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hawq.apache.org by "Zhanwei Wang (JIRA)" <ji...@apache.org> on 2016/02/02 10:31:40 UTC

[jira] [Updated] (HAWQ-385) hawq failed to initialize due to too many concurrent ssh connection to master or standby

     [ https://issues.apache.org/jira/browse/HAWQ-385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zhanwei Wang updated HAWQ-385:
------------------------------
    Assignee: Radar Lei  (was: Lei Chang)

> hawq failed to initialize due to too many concurrent ssh connection to master or standby
> ----------------------------------------------------------------------------------------
>
>                 Key: HAWQ-385
>                 URL: https://issues.apache.org/jira/browse/HAWQ-385
>             Project: Apache HAWQ
>          Issue Type: Bug
>          Components: Command Line Tools
>            Reporter: Zhanwei Wang
>            Assignee: Radar Lei
>
> {code}
> 20160202:00:58:48:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Init segments in list: ['gva-w1', 'gva-w2', 'gva-w3', 'gva-w4', 'gva-w5', 'gva-w6', 'gva-w7', 'gva-w8', 'gva-w9', 'gva-w10', 'gva-w11', 'gva-w12', 'gva-w13', 'gva-w14', 'gva-w15', 'gva-w16']
> .20160202:00:58:52:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Failed to get standby ip addresses
> 20160202:00:58:52:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning: Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> ssh_exchange_identification: Connection closed by remote host
> 20160202:00:58:52:184610 hawq_init:gva-mst1:gpadmin-[ERROR]:-HAWQ init failed on gva-w5
> ............20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning: Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning: Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning: Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning: Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning: Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning: Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Failed to get master ip addresses
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-ssh_exchange_identification: Connection closed by remote host
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[ERROR]:-HAWQ init failed on gva-w8
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning: Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning: Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning: Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Failed to get master ip addresses
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-ssh_exchange_identification: Connection closed by remote host
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[ERROR]:-HAWQ init failed on gva-w15
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning: Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning: Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Failed to get standby ip addresses
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning: Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> ssh_exchange_identification: Connection closed by remote host
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[ERROR]:-HAWQ init failed on gva-w12
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning: Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> {code}
> {code}
> ssh_exchange_identification: Connection closed by remote host
> {code}
> sshd has a default max startup connection. 
> {code}
> vi /etc/ssh/sshd_config
> #MaxStartups 10 
> {code}
> Current logic of {{hawq init cluster}} seems unclear. Master ssh to segment to executor init command, bug segments will ssh back to master to get Master/Standby ip address.
> IP address information should be collected on master and send to segments directly.
> {code}
> get_all_ip_address() {
>     if [ "${distro_based_on}" = "RedHat" ] && [ "${distro_major_version}" -ge 7 ]; then
>         cmd_str="${IFCONFIG} |${GREP} -v '127.0.0' | ${GREP} 'inet '|${AWK} '{print \$2}'"
>     elif [ "${distro_based_on}" = "Mac" ]; then
>         cmd_str="${IFCONFIG} |${GREP} -v '127.0.0' | ${GREP} 'inet '|${AWK} '{print \$2}'"
>     else
>         cmd_str="${IFCONFIG} |${GREP} -v '127.0.0' |${AWK} '/inet addr/{print substr(\$2,6)}'"
>     fi
>     master_ip_address_all=`${SSH} -o 'StrictHostKeyChecking no' ${hawqUser}@${master_host_name} "${cmd_str}"`
>     if [ -z "${master_ip_address_all}" ];then
>         ${ECHO} "Failed to get master ip addresses"
>         exit 1
>     fi
>     if [ "${standby_host_lowercase}" != "none" ] && [ -n "${standby_host_lowercase}" ];then
>         standby_ip_address_all=`${SSH} -o 'StrictHostKeyChecking no' ${hawqUser}@${standby_host_name} "${cmd_str}"`
>         if [ -z "${standby_ip_address_all}" ];then
>             ${ECHO} "Failed to get standby ip addresses"
>             exit 1
>         fi
>     fi
>     segment_ip_address_all=`${SSH} -o 'StrictHostKeyChecking no' ${hawqUser}@localhost "${cmd_str}"`
>     if [ -z "${segment_ip_address_all}" ];then
>         ${ECHO} "Failed to get segment ip addresses"
>         exit 1
>     fi
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)