[airflow] branch master updated: Docs: Clarify behavior of delete_worker_pods_on_failure (#14958)

[ka...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git


The following commit(s) were added to refs/heads/master by this push:
     new 7c2ed53  Docs: Clarify behavior of delete_worker_pods_on_failure (#14958)
7c2ed53 is described below

commit 7c2ed5394e12aa02ff280431b8d35af80d37b1f0
Author: Jed Cunningham <66...@users.noreply.github.com>
AuthorDate: Tue Mar 23 11:21:26 2021 -0600

    Docs: Clarify behavior of delete_worker_pods_on_failure (#14958)
    
    Clarify that the `delete_worker_pods_on_failure` flag only applies to worker failures, not task failures as well.
---
 airflow/config_templates/config.yml          | 2 ++
 airflow/config_templates/default_airflow.cfg | 2 ++
 2 files changed, 4 insertions(+)

diff --git a/airflow/config_templates/config.yml b/airflow/config_templates/config.yml
index 663049f..69f3671 100644
--- a/airflow/config_templates/config.yml
+++ b/airflow/config_templates/config.yml
@@ -2021,6 +2021,8 @@
       description: |
         If False (and delete_worker_pods is True),
         failed worker pods will not be deleted so users can investigate them.
+        This only prevents removal of worker pods where the worker itself failed,
+        not when the task it ran failed.
       version_added: 1.10.11
       type: string
       example: ~
diff --git a/airflow/config_templates/default_airflow.cfg b/airflow/config_templates/default_airflow.cfg
index 066fef1..d9b26fb 100644
--- a/airflow/config_templates/default_airflow.cfg
+++ b/airflow/config_templates/default_airflow.cfg
@@ -989,6 +989,8 @@ delete_worker_pods = True
 
 # If False (and delete_worker_pods is True),
 # failed worker pods will not be deleted so users can investigate them.
+# This only prevents removal of worker pods where the worker itself failed,
+# not when the task it ran failed.
 delete_worker_pods_on_failure = False
 
 # Number of Kubernetes Worker Pod creation calls per scheduler loop.