You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by aa...@apache.org on 2020/12/04 02:24:03 UTC

[hadoop] branch branch-3.1 updated (e17b7ef -> cfb9624)

This is an automated email from the ASF dual-hosted git repository.

aajisaka pushed a change to branch branch-3.1
in repository https://gitbox.apache.org/repos/asf/hadoop.git.


    from e17b7ef  MAPREDUCE-7284. TestCombineFileInputFormat#testMissingBlocks fails (#2136)
     new 43f7ab2  HDFS-13404. RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fails.
     new cfb9624  HDFS-13404. Addendum: RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fail. Contributed by Takanobu Asanuma.

The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../org/apache/hadoop/fs/contract/AbstractContractAppendTest.java   | 6 ++++++
 1 file changed, 6 insertions(+)


---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org


[hadoop] 01/02: HDFS-13404. RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fails.

Posted by aa...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

aajisaka pushed a commit to branch branch-3.1
in repository https://gitbox.apache.org/repos/asf/hadoop.git

commit 43f7ab2cf07f9bf294d00d5075c0562036ccfc1b
Author: Takanobu Asanuma <ta...@apache.org>
AuthorDate: Tue Feb 5 06:06:05 2019 +0900

    HDFS-13404. RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fails.
    
    (cherry picked from commit 559cb11551d7045015aa60afe7e7998fe0b2ef13)
---
 .../org/apache/hadoop/fs/contract/AbstractContractAppendTest.java   | 6 ++++++
 1 file changed, 6 insertions(+)

diff --git a/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractContractAppendTest.java b/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractContractAppendTest.java
index d61b635..02a8996 100644
--- a/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractContractAppendTest.java
+++ b/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractContractAppendTest.java
@@ -133,6 +133,12 @@ public abstract class AbstractContractAppendTest extends AbstractFSContractTestB
     assertPathExists("original file does not exist", target);
     byte[] dataset = dataset(256, 'a', 'z');
     FSDataOutputStream outputStream = getFileSystem().append(target);
+    if (isSupported(CREATE_VISIBILITY_DELAYED)) {
+      // Some filesystems like WebHDFS doesn't assure sequential consistency.
+      // In such a case, delay is needed. Given that we can not check the lease
+      // because here is closed in client side package, simply add a sleep.
+      Thread.sleep(10);
+    }
     outputStream.write(dataset);
     Path renamed = new Path(testPath, "renamed");
     rename(target, renamed);


---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org


[hadoop] 02/02: HDFS-13404. Addendum: RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fail. Contributed by Takanobu Asanuma.

Posted by aa...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

aajisaka pushed a commit to branch branch-3.1
in repository https://gitbox.apache.org/repos/asf/hadoop.git

commit cfb96240dc02740007de7206edf57aa8cded812e
Author: Ayush Saxena <ay...@apache.org>
AuthorDate: Wed Jun 5 22:20:26 2019 +0530

    HDFS-13404. Addendum: RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fail. Contributed by Takanobu Asanuma.
    
    (cherry picked from commit b52fd05d42d9a76f6936a5d86c23fcd66244fe3d)
---
 .../java/org/apache/hadoop/fs/contract/AbstractContractAppendTest.java  | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractContractAppendTest.java b/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractContractAppendTest.java
index 02a8996..a9fb117 100644
--- a/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractContractAppendTest.java
+++ b/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractContractAppendTest.java
@@ -137,7 +137,7 @@ public abstract class AbstractContractAppendTest extends AbstractFSContractTestB
       // Some filesystems like WebHDFS doesn't assure sequential consistency.
       // In such a case, delay is needed. Given that we can not check the lease
       // because here is closed in client side package, simply add a sleep.
-      Thread.sleep(10);
+      Thread.sleep(100);
     }
     outputStream.write(dataset);
     Path renamed = new Path(testPath, "renamed");


---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org