You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Siddharth Wagle (JIRA)" <ji...@apache.org> on 2019/05/21 22:12:00 UTC
[jira] [Created] (HDDS-1572) Implement a Pipeline scrubber to
maintain healthy number of pipelines in a cluster
Siddharth Wagle created HDDS-1572:
-------------------------------------
Summary: Implement a Pipeline scrubber to maintain healthy number of pipelines in a cluster
Key: HDDS-1572
URL: https://issues.apache.org/jira/browse/HDDS-1572
Project: Hadoop Distributed Data Store
Issue Type: Sub-task
Components: SCM
Reporter: Siddharth Wagle
Assignee: Siddharth Wagle
The design document talks about initial requirements for the pipeline scrubber.
- Maintain a datastructure for datanodes violating the pipeline membership soft upper bound.
- Scan the pipelines that the nodes are a part of to select candidates for teardown.
- Scan pipelines that do not have open containers currently in use and datanodes are in violation.
- Schedule tear down operation if a candidate pipeline is found.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org