You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-issues@hadoop.apache.org by "Yiqun Lin (Jira)" <ji...@apache.org> on 2020/10/27 02:31:00 UTC

[jira] [Updated] (HDFS-15640) Add snapshot diff threshold to FedBalance

     [ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yiqun Lin updated HDFS-15640:
-----------------------------
    Summary: Add snapshot diff threshold to FedBalance  (was: RBF: Add fast distcp threshold to FedBalance.)

> Add snapshot diff threshold to FedBalance
> -----------------------------------------
>
>                 Key: HDFS-15640
>                 URL: https://issues.apache.org/jira/browse/HDFS-15640
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Jinglun
>            Assignee: Jinglun
>            Priority: Major
>         Attachments: HDFS-15640.001.patch, HDFS-15640.002.patch, HDFS-15640.003.patch, HDFS-15640.004.patch
>
>
> Currently in the DistCpProcedure it must submit distcp round by round until there is no diff to go to the final distcp stage. The condition is very strict. If the distcp could finish in an acceptable period then we don't need to wait for no diff. For example if 3 consecutive distcp jobs all finish within 10 minutes then we can predict the final distcp could also finish within 10 minutes. So we can start the final distcp directly.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org