You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/01/26 17:47:43 UTC
[GitHub] [airflow] armandleopold opened a new issue #13917: KubernetesExecutor Pod not deleted
armandleopold opened a new issue #13917:
URL: https://github.com/apache/airflow/issues/13917
**Apache Airflow version**: 2.0.0
**Kubernetes version**: 1.15.5
**Environment**: private.cloud
- **Install tools**: helm chart bitnami
**What happened**:
When running a DAG with KubernetesExecutor and KubernetesPodOperator, at the end of the DAG, the pod launched by the KubernetesExecutor doesn't disapear even with
```
- name: AIRFLOW__KUBERNETES__DELETE_WORKER_PODS
value: "True"
```
**What you expected to happen**:
At the end of the DAG run, the worker pod launched with the kubernetesExecutor disapear.
**How to reproduce it**:
* Install Airflow 2.0 with KubernetesExecutor
* Launch a DAG with podOperator
* check if the pod launched by the KubernetesExecutor disapeared.
* The pod is in a loop :
(from the scheduler) :
```
[2021-01-26 17:42:10,957] {kubernetes_executor.py:147} INFO - Event: javahelloworldprintarmand10-65794b003e2a40c69dc6fae97d0c95e7 had an event of type MODIFIED
[2021-01-26 17:42:10,957] {kubernetes_executor.py:210} INFO - Event: javahelloworldprintarmand10-65794b003e2a40c69dc6fae97d0c95e7 is Running
[2021-01-26 17:42:13,103] {kubernetes_executor.py:147} INFO - Event: javahelloworldprintarmand10-65794b003e2a40c69dc6fae97d0c95e7 had an event of type MODIFIED
[2021-01-26 17:42:13,103] {kubernetes_executor.py:210} INFO - Event: javahelloworldprintarmand10-65794b003e2a40c69dc6fae97d0c95e7 is Running
[2021-01-26 17:42:26,888] {kubernetes_executor.py:147} INFO - Event: javahelloworldprintarmand10-65794b003e2a40c69dc6fae97d0c95e7 had an event of type MODIFIED
[2021-01-26 17:42:26,888] {kubernetes_executor.py:210} INFO - Event: javahelloworldprintarmand10-65794b003e2a40c69dc6fae97d0c95e7 is Running
```
(from the pod Loop Restarting) :
```
[2021-01-26 17:42:11,764] {dagbag.py:440} INFO - Filling up the DagBag from /opt/bitnami/airflow/dags/git-airflow-dags/example-dags/java-hello-world.py
/opt/bitnami/airflow/venv/lib/python3.8/site-packages/airflow/providers/cncf/kubernetes/backcompat/backwards_compat_converters.py:26 DeprecationWarning: This module is deprecated. Please use `kubernetes.client.models.V1Volume`.
/opt/bitnami/airflow/venv/lib/python3.8/site-packages/airflow/providers/cncf/kubernetes/backcompat/backwards_compat_converters.py:27 DeprecationWarning: This module is deprecated. Please use `kubernetes.client.models.V1VolumeMount`.
Running <TaskInstance: java-hello-world.printarmand10 2021-01-26T17:36:05.584694+00:00 [success]> on host javahelloworldprintarmand10-65794b003e2a40c69dc6fae97d0c95e7
```
**Anything else we need to know**:
Happens 100% of the time.
The Airflow frontend doesn't show the anomaly.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] dimberman commented on issue #13917: KubernetesExecutor Pod not deleted
Posted by GitBox <gi...@apache.org>.
dimberman commented on issue #13917:
URL: https://github.com/apache/airflow/issues/13917#issuecomment-779401165
@armandleopold are you sure the task is completed? Those logs seem to suggest that it's still running.
Can you `kubectl describe pod` on the pod?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] armandleopold closed issue #13917: KubernetesExecutor Pod not deleted
Posted by GitBox <gi...@apache.org>.
armandleopold closed issue #13917:
URL: https://github.com/apache/airflow/issues/13917
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] armandleopold commented on issue #13917: KubernetesExecutor Pod not deleted
Posted by GitBox <gi...@apache.org>.
armandleopold commented on issue #13917:
URL: https://github.com/apache/airflow/issues/13917#issuecomment-780545459
I am sorry, i cannot reproduce the error because i have switched to LocalExecutor.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org