You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by st...@apache.org on 2021/06/12 16:45:39 UTC

[hadoop] branch trunk updated: HADOOP-17547 Magic committer to downgrade abort in cleanup if list uploads fails with access denied (#3051)

This is an automated email from the ASF dual-hosted git repository.

stevel pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/hadoop.git


The following commit(s) were added to refs/heads/trunk by this push:
     new de9ca9f  HADOOP-17547 Magic committer to downgrade abort in cleanup if list uploads fails with access denied (#3051)
de9ca9f is described below

commit de9ca9f155559bcb93ab5c82e752961f69761a9d
Author: Petre Bogdan Stolojan <st...@gmail.com>
AuthorDate: Sat Jun 12 17:45:12 2021 +0100

    HADOOP-17547 Magic committer to downgrade abort in cleanup if list uploads fails with access denied (#3051)
    
    
    
    Contributed by Bogdan Stolojan
---
 .../java/org/apache/hadoop/fs/s3a/commit/AbstractS3ACommitter.java    | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/commit/AbstractS3ACommitter.java b/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/commit/AbstractS3ACommitter.java
index 1fd2496..2005bc8 100644
--- a/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/commit/AbstractS3ACommitter.java
+++ b/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/commit/AbstractS3ACommitter.java
@@ -832,8 +832,8 @@ public abstract class AbstractS3ACommitter extends PathOutputCommitter
       try {
         pending = ops.listPendingUploadsUnderPath(dest);
       } catch (IOException e) {
-        // raised if the listPendingUploads call failed.
-        maybeIgnore(suppressExceptions, "aborting pending uploads", e);
+        // Swallow any errors given this is best effort
+        LOG.debug("Failed to list pending uploads under {}", dest, e);
         return;
       }
       if (!pending.isEmpty()) {

---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org