You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "vatsrahul1001 (via GitHub)" <gi...@apache.org> on 2025/04/15 05:59:17 UTC
[I] KPO task failing [airflow]
vatsrahul1001 opened a new issue, #49275:
URL: https://github.com/apache/airflow/issues/49275
### Apache Airflow version
3.0.0
### If "Other Airflow 2 version" selected, which one?
_No response_
### What happened?
KPO task failing with celery
```
[2025-04-15, 05:49:34] ERROR - Task failed with exception: source="task"
ValueError: I/O operation on closed file.
File "/usr/local/lib/python3.12/site-packages/airflow/sdk/execution_time/task_runner.py", line 809 in run
File "/usr/local/lib/python3.12/site-packages/airflow/sdk/execution_time/task_runner.py", line 1072 in _execute_task
File "/usr/local/lib/python3.12/site-packages/airflow/sdk/bases/operator.py", line 408 in wrapper
File "/usr/local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/operators/pod.py", line 583 in execute
File "/usr/local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/operators/pod.py", line 591 in execute_sync
File "/usr/local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/operators/pod.py", line 1157 in build_pod_request_obj
File "/usr/local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/hooks/kubernetes.py", line 292 in is_in_cluster
File "/usr/local/lib/python3.12/functools.py", line 998 in __get__
File "/usr/local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/hooks/kubernetes.py", line 300 in api_client
File "/usr/local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/hooks/kubernetes.py", line 212 in get_conn
File "/usr/local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/hooks/kubernetes.py", line 205 in _get_field
File "/usr/local/lib/python3.12/functools.py", line 998 in __get__
File "/usr/local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/hooks/kubernetes.py", line 186 in conn_extras
File "/usr/local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/hooks/kubernetes.py", line 176 in get_connection
File "/usr/local/lib/python3.12/site-packages/airflow/hooks/base.py", line 64 in get_connection
File "/usr/local/lib/python3.12/site-packages/airflow/models/connection.py", line 473 in get_connection_from_secrets
File "/usr/local/lib/python3.12/site-packages/airflow/sdk/definitions/connection.py", line 142 in get
File "/usr/local/lib/python3.12/site-packages/airflow/sdk/execution_time/context.py", line 127 in _get_connection
File "/usr/local/lib/python3.12/site-packages/airflow/sdk/execution_time/supervisor.py", line 1182 in ensure_secrets_backend_loaded
File "/usr/local/lib/python3.12/site-packages/structlog/_native.py", line 144 in meth
File "/usr/local/lib/python3.12/site-packages/structlog/_base.py", line 223 in _proxy_to_logger
File "/usr/local/lib/python3.12/site-packages/structlog/_output.py", line 217 in msg
[2025-04-15, 05:49:34] INFO - OpenLineageClient will use `http` transport: source="openlineage.client.client"
```
### What you think should happen instead?
_No response_
### How to reproduce
1. Run a KPO task in celery or K8s
### Operating System
Linux
### Versions of Apache Airflow Providers
_No response_
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
_No response_
### Anything else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] KPO task failing [airflow]
Posted by "vatsrahul1001 (via GitHub)" <gi...@apache.org>.
vatsrahul1001 commented on issue #49275:
URL: https://github.com/apache/airflow/issues/49275#issuecomment-2804055716
Closing this verified that this worksnow with https://github.com/apache/airflow/pull/49235
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] KPO task failing [airflow]
Posted by "phanikumv (via GitHub)" <gi...@apache.org>.
phanikumv commented on issue #49275:
URL: https://github.com/apache/airflow/issues/49275#issuecomment-2803958401
#49235 should already have fixed this. Rahul will re test this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] KPO task failing [airflow]
Posted by "phanikumv (via GitHub)" <gi...@apache.org>.
phanikumv commented on issue #49275:
URL: https://github.com/apache/airflow/issues/49275#issuecomment-2803959882
Cc @amoghrajesh
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] KPO task failing [airflow]
Posted by "vatsrahul1001 (via GitHub)" <gi...@apache.org>.
vatsrahul1001 closed issue #49275: KPO task failing
URL: https://github.com/apache/airflow/issues/49275
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org