You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by st...@apache.org on 2025/04/03 14:18:40 UTC
(hadoop) 04/04: HADOOP-19516. S3A: SDK reads content twice during PUT to S3 Express store.
This is an automated email from the ASF dual-hosted git repository.
stevel pushed a commit to branch branch-3.4
in repository https://gitbox.apache.org/repos/asf/hadoop.git
commit f3ec55b5911d1e5e7da438c64f614a59a7db62a3
Author: Steve Loughran <st...@cloudera.com>
AuthorDate: Wed Mar 26 17:37:22 2025 +0000
HADOOP-19516. S3A: SDK reads content twice during PUT to S3 Express store.
Downgrade warning message from INFO to DEBUG.
Note: this does not fix the apparent issue, merely stops the log message
being printed during single-object PUTs to S3 Express storage.
Contributed by Steve Loughran.
---
.../java/org/apache/hadoop/fs/s3a/impl/UploadContentProviders.java | 4 +++-
1 file changed, 3 insertions(+), 1 deletion(-)
diff --git a/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/UploadContentProviders.java b/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/UploadContentProviders.java
index d1fb28257f2..9716a09158e 100644
--- a/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/UploadContentProviders.java
+++ b/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/UploadContentProviders.java
@@ -286,7 +286,9 @@ public final InputStream newStream() {
// the stream has been recreated for the first time.
// notify only once for this stream, so as not to flood
// the logs.
- LOG.info("Stream recreated: {}", this);
+ // originally logged at info; logs at debug because HADOOP-19516
+ // means that this message is very common with S3 Express stores.
+ LOG.debug("Stream recreated: {}", this);
}
return setCurrentStream(createNewStream());
}
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org