[jira] [Commented] (HDFS-11564) Ozone: SCM: Add Comparable Metric Support

["Anu Engineer (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HDFS-11564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15939001#comment-15939001 ] 

Anu Engineer commented on HDFS-11564:
-------------------------------------

The algorithms of choosing 2 random nodes and then placing the container on the lower utilization node is discussed in great depth in this survey paper.
https://pdfs.semanticscholar.org/3597/66cb47572028eb70c797115e987ff203e83f.pdf


> Ozone: SCM: Add Comparable Metric Support
> -----------------------------------------
>
>                 Key: HDFS-11564
>                 URL: https://issues.apache.org/jira/browse/HDFS-11564
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ozone
>    Affects Versions: HDFS-7240
>            Reporter: Anu Engineer
>            Assignee: Anu Engineer
>
> While picking the datanode or the pool to place a container, SCM needs to be able to compare pools and datanodes. This jira proposes to add a Comparable Metric interface from which DatanodeCapacity and DatanodeIOLoad metrics can be derived. This will also convert SCM Container Placement Capacity policy to use these metrics.
> Adding these metrics makes all placement policy operate on the basis of these metrics and it makes it easy to simulate cluster imbalances as well as reason about code. All new SCM metrics which have the property of total ordering should be derived from this interface.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org