You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "zhuobin zheng (Jira)" <ji...@apache.org> on 2021/05/24 08:39:00 UTC
[jira] [Commented] (HDFS-13522) Support observer node from
Router-Based Federation
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17350302#comment-17350302 ]
zhuobin zheng commented on HDFS-13522:
--------------------------------------
Hi, [~hemanthboyina], [^HDFS-13522_WIP.patch] is a nice patch !!
Given that you haven't updated the code for a long time, i try to update it to adapt to current trunk branch. ([^HDFS-13522.002.patch])
Only made the following changes:
# Fit code to current trunk
# Fix Web HDFS NPE. (Patch Line: 1085,1070. Null check before use)
# Double cache in MembershipNamenodeResolver, to avoid NNs sort every time. (fields: observerFirstCacheNS)
# Update Observer NN state to Unavailable, to avoid access unavailable NN. (Patch Line: 875.)
# Msync Locked in NS Level, not global level. And removed unlock logic when sync configured 0ms , for reduce msync times. (May be unnecessary optimization. Can add this logic back if it is useful.) (Patch Line: 1038)
Can you help for review in your free time? [~csun] [~xkrogen] [~hemanthboyina] [~surendralilhore] [~crh]
> Support observer node from Router-Based Federation
> --------------------------------------------------
>
> Key: HDFS-13522
> URL: https://issues.apache.org/jira/browse/HDFS-13522
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: federation, namenode
> Reporter: Erik Krogen
> Assignee: Chao Sun
> Priority: Major
> Labels: pull-request-available
> Attachments: HDFS-13522.001.patch, HDFS-13522.002.patch, HDFS-13522_WIP.patch, RBF_ Observer support.pdf, Router+Observer RPC clogging.png, ShortTerm-Routers+Observer.png
>
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
> Changes will need to occur to the router to support the new observer node.
> One such change will be to make the router understand the observer state, e.g. {{FederationNamenodeServiceState}}.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org