You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Hari Mankude (Created) (JIRA)" <ji...@apache.org> on 2012/04/06 19:11:23 UTC
[jira] [Created] (HDFS-3217) ZKFC should restart NN when
healthmonitor gets a SERVICE_NOT_RESPONDING exception
ZKFC should restart NN when healthmonitor gets a SERVICE_NOT_RESPONDING exception
---------------------------------------------------------------------------------
Key: HDFS-3217
URL: https://issues.apache.org/jira/browse/HDFS-3217
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Hari Mankude
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3217) ZKFC should restart NN when
healthmonitor gets a SERVICE_NOT_RESPONDING exception
Posted by "Hari Mankude (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248621#comment-13248621 ]
Hari Mankude commented on HDFS-3217:
------------------------------------
bq.I disagree. It is an explicit decision to not have the ZKFC act as a service supervisor, because it adds a lot of complexity. There already exist lots of solutions for service management - we assume that the user is already using something like puppet, daemontools, supervisord, cron, etc, to make sure the daemon restarts eventually.
I did not find a reference to an external monitoring tool in the HA design docs. So apologies there. If the scanning interval of the external tools is significant, it might still make sense for FC to restart the NN directly. With one of the NN processes down, the cluster is functioning in a degraded state and the longer it takes to restart the standby NN process, longer the recovery time is going to be.
> ZKFC should restart NN when healthmonitor gets a SERVICE_NOT_RESPONDING exception
> ---------------------------------------------------------------------------------
>
> Key: HDFS-3217
> URL: https://issues.apache.org/jira/browse/HDFS-3217
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: auto-failover, ha
> Reporter: Hari Mankude
> Assignee: Hari Mankude
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3217) ZKFC should restart NN when
healthmonitor gets a SERVICE_NOT_RESPONDING exception
Posted by "Todd Lipcon (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248589#comment-13248589 ]
Todd Lipcon commented on HDFS-3217:
-----------------------------------
I disagree. It is an explicit decision to not have the ZKFC act as a service supervisor, because it adds a lot of complexity. There already exist lots of solutions for service management - we assume that the user is already using something like puppet, daemontools, supervisord, cron, etc, to make sure the daemon restarts eventually.
> ZKFC should restart NN when healthmonitor gets a SERVICE_NOT_RESPONDING exception
> ---------------------------------------------------------------------------------
>
> Key: HDFS-3217
> URL: https://issues.apache.org/jira/browse/HDFS-3217
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: auto-failover, ha
> Reporter: Hari Mankude
> Assignee: Hari Mankude
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3217) ZKFC should restart NN when
healthmonitor gets a SERVICE_NOT_RESPONDING exception
Posted by "Hari Mankude (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248504#comment-13248504 ]
Hari Mankude commented on HDFS-3217:
------------------------------------
ZKFC should restart NN when it sees a SERVICE_NOT_RESPONDING exception. NN might have aborted due to loss of quorum and unless there is manual intervention, NN will not be restarted.
> ZKFC should restart NN when healthmonitor gets a SERVICE_NOT_RESPONDING exception
> ---------------------------------------------------------------------------------
>
> Key: HDFS-3217
> URL: https://issues.apache.org/jira/browse/HDFS-3217
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: auto-failover, ha
> Reporter: Hari Mankude
> Assignee: Hari Mankude
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HDFS-3217) ZKFC should restart NN when
healthmonitor gets a SERVICE_NOT_RESPONDING exception
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon resolved HDFS-3217.
-------------------------------
Resolution: Won't Fix
We had some offline discussion about this and it seems like folks are on board with the current design (i.e. that the failover controller doesn't directly launch or restart the namenode). We can revisit in the future should the current design prove problematic. Resolving as wontfix for now.
> ZKFC should restart NN when healthmonitor gets a SERVICE_NOT_RESPONDING exception
> ---------------------------------------------------------------------------------
>
> Key: HDFS-3217
> URL: https://issues.apache.org/jira/browse/HDFS-3217
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: auto-failover, ha
> Reporter: Hari Mankude
> Assignee: Hari Mankude
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HDFS-3217) ZKFC should restart NN when
healthmonitor gets a SERVICE_NOT_RESPONDING exception
Posted by "Hari Mankude (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hari Mankude reassigned HDFS-3217:
----------------------------------
Assignee: Hari Mankude
> ZKFC should restart NN when healthmonitor gets a SERVICE_NOT_RESPONDING exception
> ---------------------------------------------------------------------------------
>
> Key: HDFS-3217
> URL: https://issues.apache.org/jira/browse/HDFS-3217
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: auto-failover, ha
> Reporter: Hari Mankude
> Assignee: Hari Mankude
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira