You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "He Xiaoqiao (JIRA)" <ji...@apache.org> on 2019/07/05 12:21:00 UTC
[jira] [Comment Edited] (HDFS-12703) Exceptions are fatal to
decommissioning monitor
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16879187#comment-16879187 ]
He Xiaoqiao edited comment on HDFS-12703 at 7/5/19 12:20 PM:
-------------------------------------------------------------
Thanks [~elgoiri], [~sodonnell] for your comment, I would like to follow up this issue and submit patch later based on above suggestions if [~xuel1] has no time. Thanks again.
was (Author: hexiaoqiao):
Thanks [~elgoiri], [~sodonnell] for your comment, I would like to follow up this issue and submit patch based on above suggestions if [~xuel1] has no time. Thanks again.
> Exceptions are fatal to decommissioning monitor
> -----------------------------------------------
>
> Key: HDFS-12703
> URL: https://issues.apache.org/jira/browse/HDFS-12703
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: namenode
> Affects Versions: 2.7.0
> Reporter: Daryn Sharp
> Assignee: Xue Liu
> Priority: Critical
> Attachments: HDFS-12703.001.patch, HDFS-12703.002.patch, HDFS-12703.003.patch, HDFS-12703.004.patch
>
>
> The {{DecommissionManager.Monitor}} runs as an executor scheduled task. If an exception occurs, all decommissioning ceases until the NN is restarted. Per javadoc for {{executor#scheduleAtFixedRate}}: *If any execution of the task encounters an exception, subsequent executions are suppressed*. The monitor thread is alive but blocked waiting for an executor task that will never come. The code currently disposes of the future so the actual exception that aborted the task is gone.
> Failover is insufficient since the task is also likely dead on the standby. Replication queue init after the transition to active will fix the under replication of blocks on currently decommissioning nodes but future nodes never decommission. The standby must be bounced prior to failover – and hopefully the error condition does not reoccur.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org