[jira] [Commented] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

["zhengchenyu (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17626553#comment-17626553 ] 

zhengchenyu commented on HDFS-13522:
------------------------------------

[~simbadzina] Thanks for your great patch, this design is very clever! Can you share some experience about you production environment?  In this design, many client share the pool state id, can we set auto msync period time to -1 or a very big value in client side?

> HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.
> --------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-13522
>                 URL: https://issues.apache.org/jira/browse/HDFS-13522
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: federation, namenode
>            Reporter: Erik Krogen
>            Assignee: Simbarashe Dzinamarira
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 3.4.0, 3.3.5
>
>         Attachments: HDFS-13522.001.patch, HDFS-13522.002.patch, HDFS-13522_WIP.patch, RBF_ Observer support.pdf, Router+Observer RPC clogging.png, ShortTerm-Routers+Observer.png, observer_reads_in_rbf_proposal_simbadzina_v1.pdf, observer_reads_in_rbf_proposal_simbadzina_v2.pdf
>
>          Time Spent: 20h 50m
>  Remaining Estimate: 0h
>
> Changes will need to occur to the router to support the new observer node.
> One such change will be to make the router understand the observer state, e.g. {{{}FederationNamenodeServiceState{}}}.
> This patch captures the state of all namespaces in the routers and propagates it to clients. A follow up patch will change router behavior to direct requests to the observer.
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org