You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "amzar96 (via GitHub)" <gi...@apache.org> on 2023/04/19 13:39:19 UTC
[GitHub] [airflow] amzar96 commented on issue #15456: KubernetesPodOperator raises 404 Not Found when `is_delete_operator_pod=True` and the Pod fails.
amzar96 commented on issue #15456:
URL: https://github.com/apache/airflow/issues/15456#issuecomment-1514755540
Hi @eladkal, I am facing the same issue.
Here is our configuration
```
KubernetesPodOperator(
.....,
get_logs=True,
is_delete_operator_pod=False,
config_file=kube_config_path,
in_cluster=False,
cluster_context='aws',
image_pull_policy="Always",
startup_timeout_seconds=600,
on_failure_callback=on_failure,
dag=dag,
)
```
As above, `is_delete_operator_pod` is set to `False`. FYI, this pod is calling AWS Glue Crawler and in reality, the crawler was successfully run without any error. But why in Airflow the stats is FAILED and not found the pod?
Our Airflow requirements.txt
```
--constraint "https://raw.githubusercontent.com/apache/airflow/constraints-2.0.2/constraints-3.7.txt"
awscli
kubernetes
cryptography
watchtower
apache-airflow[cncf.kubernetes]
apache-airflow[opsgenie]
apache-airflow-providers-http
apache-airflow-providers-ssh
apache-airflow-providers-postgres
# airflow-notify-sns
apache-airflow[amazon]
```
Not sure if upgrade the version can solve the issue or not.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org