You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by ro...@apache.org on 2025/02/03 11:37:47 UTC
(airflow) branch main updated: Add info that delete_local_logs also works for HDFS remote logging (#46287)
This is an automated email from the ASF dual-hosted git repository.
rom pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 8a3757b99e2 Add info that delete_local_logs also works for HDFS remote logging (#46287)
8a3757b99e2 is described below
commit 8a3757b99e247d2f09a86d12e6aff8d525a3f3e7
Author: Aakcht <aa...@gmail.com>
AuthorDate: Mon Feb 3 16:37:42 2025 +0500
Add info that delete_local_logs also works for HDFS remote logging (#46287)
---
airflow/config_templates/config.yml | 2 +-
.../administration-and-deployment/logging-monitoring/logging-tasks.rst | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/airflow/config_templates/config.yml b/airflow/config_templates/config.yml
index cd800cb98e5..8e8726bd07e 100644
--- a/airflow/config_templates/config.yml
+++ b/airflow/config_templates/config.yml
@@ -739,7 +739,7 @@ logging:
default: ""
delete_local_logs:
description: |
- Whether the local log files for GCS, S3, WASB and OSS remote logging should be deleted after
+ Whether the local log files for GCS, S3, WASB, HDFS and OSS remote logging should be deleted after
they are uploaded to the remote location.
version_added: 2.6.0
type: string
diff --git a/docs/apache-airflow/administration-and-deployment/logging-monitoring/logging-tasks.rst b/docs/apache-airflow/administration-and-deployment/logging-monitoring/logging-tasks.rst
index 3ea26deed6f..fa68ffca63e 100644
--- a/docs/apache-airflow/administration-and-deployment/logging-monitoring/logging-tasks.rst
+++ b/docs/apache-airflow/administration-and-deployment/logging-monitoring/logging-tasks.rst
@@ -25,7 +25,7 @@ Core Airflow provides an interface FileTaskHandler, which writes task logs to fi
services (:doc:`apache-airflow-providers:index`) and some of them provide handlers that extend the logging
capability of Apache Airflow. You can see all of these providers in :doc:`apache-airflow-providers:core-extensions/logging`.
-When using S3, GCS, WASB or OSS remote logging service, you can delete the local log files after
+When using S3, GCS, WASB, HDFS or OSS remote logging service, you can delete the local log files after
they are uploaded to the remote location, by setting the config:
.. code-block:: ini