You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/04/28 21:26:11 UTC

[GitHub] [airflow] ausiddiqui commented on issue #12136: KubernetesPodOperator breaks with active log-collection for long running tasks

ausiddiqui commented on issue #12136:
URL: https://github.com/apache/airflow/issues/12136#issuecomment-828790593


   Yes I'm having this issue running Airflow 1.10.12 with KubernetesPodOperator which is running a queries packaged in a Docker image. We are running long-running queries where the queries will be running and producing the logs in Airflow for 2-4 hours and then at 3hrs 59 minutes of query logs we would just get:
   ```log
   INFO - Event <pod_name> had an event of type Running
   INFO - Event: <pod_name> has state running
   ```
    repeated every 2 seconds for 2.5 to 3.5 hours until a failed state.
   ```log
   INFO - Event <pod_name> had an event of type Failed
   ```
   
   > Is anyone still having the issue mentioned by @yamrzou , I'm using airflow 1.10.14 and have a similar issue where the logs of a long running task are similar to [#12136 (comment)](https://github.com/apache/airflow/issues/12136#issuecomment-756233260).
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org