You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/12/12 20:15:28 UTC
[GitHub] [airflow] dstandish opened a new issue, #28314: logs from k8s executor tasks are not visible while task running
dstandish opened a new issue, #28314:
URL: https://github.com/apache/airflow/issues/28314
### Body
with celery executor, while tasks are running, on celery worker, we serve logs up with a mini web server, and the airflow webserver reads from there.
with kubernetes executor we don’t do that and instead airflow webserver reads from k8s pod logs.
the problem is that when tasks are running we redirect stdout to logs so that if you do print in your tasks it will still get captured.
i tried ([pr](https://github.com/apache/airflow/pull/28238)) running k8s tasks with --interactive and this half worked but but resulted in some things going to stdout and some going to logs — not everything in both places (which is what we desire).
i have a feeling that best way forward might be to “fix” interactive mode so that it logs to both places — i.e. still logs to file / handlers, but also tees everything to stdout somehow. (edited)
### Committer
- [X] I acknowledge that I am a maintainer/committer of the Apache Airflow project.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] logs from k8s executor tasks are not visible while task running [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #28314:
URL: https://github.com/apache/airflow/issues/28314#issuecomment-1874928370
This issue has been automatically marked as stale because it has been open for 365 days without any activity. There has been several Airflow releases since last activity on this issue. Kindly asking to recheck the report against latest Airflow version and let us know if the issue is reproducible. The issue will be closed in next 30 days if no further activity occurs from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] logs from k8s executor tasks are not visible while task running [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #28314: logs from k8s executor tasks are not visible while task running
URL: https://github.com/apache/airflow/issues/28314
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] logs from k8s executor tasks are not visible while task running [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #28314:
URL: https://github.com/apache/airflow/issues/28314#issuecomment-1925180747
This issue has been closed because it has not received response from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org