You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Sahil Takiar (Jira)" <ji...@apache.org> on 2020/01/30 01:20:00 UTC
[jira] [Commented] (IMPALA-9342) Membership updates should only
remove a node from the blacklist if it is quiescing
[ https://issues.apache.org/jira/browse/IMPALA-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17026361#comment-17026361 ]
Sahil Takiar commented on IMPALA-9342:
--------------------------------------
[~twmarshall] let me know if this makes sense. Will post a patch shortly.
> Membership updates should only remove a node from the blacklist if it is quiescing
> ----------------------------------------------------------------------------------
>
> Key: IMPALA-9342
> URL: https://issues.apache.org/jira/browse/IMPALA-9342
> Project: IMPALA
> Issue Type: Sub-task
> Components: Backend
> Reporter: Sahil Takiar
> Assignee: Sahil Takiar
> Priority: Major
>
> {{ClusterMembershipMgr::UpdateMembership}} will remove a node from the blacklist (if it is on the blacklist) if the method receives an update from the Statestore about the node. Currently, the Statestore *should* only send an update about the node if the node starts quiescing. If a node starts quiescing, it should be removed from the blacklist since it quiescing nodes aren't part of any executor groups anyway (no queries should be scheduled on them).
> After running some experiments locally, it seems there are some other cases where the Statestore sends the {{ClusterMembershipMgr}} an update about a node even if it's quiescing state has not changed. Unfortunately, I haven't been able to fully track down what is triggering this, so far it only happens on cluster start up.
> The {{ClusterMembershipMgr}} should only un-blacklist a node if that node is quiescing, currently it un-blacklists a node on any update to the node.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org