You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by me...@apache.org on 2023/06/27 14:52:09 UTC
[hadoop] branch trunk updated: HADOOP-18764. fs.azure.buffer.dir to be under Yarn container path on yarn applications (#5737)
This is an automated email from the ASF dual-hosted git repository.
mehakmeet pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/trunk by this push:
new 5db7107b773 HADOOP-18764. fs.azure.buffer.dir to be under Yarn container path on yarn applications (#5737)
5db7107b773 is described below
commit 5db7107b773fc799d2a92e2a388816352ba40204
Author: Mehakmeet Singh <me...@gmail.com>
AuthorDate: Tue Jun 27 20:22:00 2023 +0530
HADOOP-18764. fs.azure.buffer.dir to be under Yarn container path on yarn applications (#5737)
Changing fs.azure.buffer.dir for azure so things clean up better in long-lived yarn clusters.
Contributed by: Mehakmeet Singh
---
.../hadoop-common/src/main/resources/core-default.xml | 6 ++++--
1 file changed, 4 insertions(+), 2 deletions(-)
diff --git a/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml b/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
index 34dadf31608..438e2df1372 100644
--- a/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
+++ b/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
@@ -2165,9 +2165,11 @@ The switch to turn S3A auditing on or off.
<property>
<name>fs.azure.buffer.dir</name>
- <value>${hadoop.tmp.dir}/abfs</value>
+ <value>${env.LOCAL_DIRS:-${hadoop.tmp.dir}}/abfs</value>
<description>Directory path for buffer files needed to upload data blocks
- in AbfsOutputStream.</description>
+ in AbfsOutputStream.
+ Yarn container path will be used as default value on yarn applications,
+ otherwise fall back to hadoop.tmp.dir </description>
</property>
<property>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org