You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "zhengchenyu (Jira)" <ji...@apache.org> on 2020/12/24 09:48:00 UTC
[jira] [Updated] (HDFS-15750) RBF: Make sure the multi destination
are consistent after write operation
[ https://issues.apache.org/jira/browse/HDFS-15750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
zhengchenyu updated HDFS-15750:
-------------------------------
Description:
Nowdays, RBF can't make sure
If /user/userA is mountable which mounts two nameservice: ns1, ns2. But if both hdfs://ns1/user/userA/a.log and hdfs://ns2/user/userA/a.log exists. I want to remove hdfs://ns-fed/user/userA/a.log (Note: a.log is file) to trash, then only one nameservice take effect. I think it means inconsistence.
(Note: In fact, when migration data from one ns1 to ns2 (a mountable mouts ns1 and ns2) , and rewrite some hive table's old partition, this problem would occure!)
In other way, if we hdfs://ns-fed/user/userA/dirA (Note: dirA is directroy.) If hdfs://ns1/user/userA/dirA's permission is not same with hdfs://ns2/user/userA/dirA's permission. Or one of nameservice is down. We maybe can't rename all location. I think it also means inconsistence.
I think we need stricter check. If one operation (which shoud success) failed , we should throw exception.
> RBF: Make sure the multi destination are consistent after write operation
> --------------------------------------------------------------------------
>
> Key: HDFS-15750
> URL: https://issues.apache.org/jira/browse/HDFS-15750
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: zhengchenyu
> Priority: Major
>
> Nowdays, RBF can't make sure
> If /user/userA is mountable which mounts two nameservice: ns1, ns2. But if both hdfs://ns1/user/userA/a.log and hdfs://ns2/user/userA/a.log exists. I want to remove hdfs://ns-fed/user/userA/a.log (Note: a.log is file) to trash, then only one nameservice take effect. I think it means inconsistence.
> (Note: In fact, when migration data from one ns1 to ns2 (a mountable mouts ns1 and ns2) , and rewrite some hive table's old partition, this problem would occure!)
> In other way, if we hdfs://ns-fed/user/userA/dirA (Note: dirA is directroy.) If hdfs://ns1/user/userA/dirA's permission is not same with hdfs://ns2/user/userA/dirA's permission. Or one of nameservice is down. We maybe can't rename all location. I think it also means inconsistence.
> I think we need stricter check. If one operation (which shoud success) failed , we should throw exception.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org