You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "JiangHua Zhu (Jira)" <ji...@apache.org> on 2022/10/18 07:05:00 UTC

[jira] [Commented] (HDFS-14750) RBF: Improved isolation for downstream name nodes. {Dynamic}

    [ https://issues.apache.org/jira/browse/HDFS-14750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17619276#comment-17619276 ] 

JiangHua Zhu commented on HDFS-14750:
-------------------------------------

Thanks [~xuzq_zander] for the work.
I have read your design and have some doubts:
1. Will the penalty time produced during the router run really disappear a lot?
2. Will it affect existing features such as Quota.
3. Overall, RBF still has a lot of room for development, and some compatibility needs to be considered.
I have some ideas of my own that I can add to, if I can.
1: Add additional functions to each Router. include:
   1.1. Collect your own processing performance indicators, similar to the role of sliding windows.
   1.2. Dynamically set the maximum allowable processing upper limit according to the value of the sliding window.
2. Isolate the exception handler and namespace.
Through these processes, the current problems can be effectively alleviated, and good compatibility can also be maintained.


> RBF: Improved isolation for downstream name nodes. {Dynamic}
> ------------------------------------------------------------
>
>                 Key: HDFS-14750
>                 URL: https://issues.apache.org/jira/browse/HDFS-14750
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: CR Hota
>            Assignee: CR Hota
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 4h
>  Remaining Estimate: 0h
>
> This Jira tracks the work around dynamic allocation of resources in routers for downstream hdfs clusters. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org