You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "dheerajturaga (via GitHub)" <gi...@apache.org> on 2024/09/27 19:10:16 UTC

[I] Try number inconsistency between webserver [airflow]

dheerajturaga opened a new issue, #42549:
URL: https://github.com/apache/airflow/issues/42549

   ### Apache Airflow version
   
   Other Airflow 2 version (please specify below)
   
   ### If "Other Airflow 2 version" selected, which one?
   
   2.10.2
   
   ### What happened?
   
   Some tasks in airflow 2.10.2 are being launched with try number 0. However, the webserver is looking for logs starting with try number 1. Because of this we are having cases where tasks are running and passing however, the server throws a "cannot read served logs" error.
   
   Executor=CeleryExecutor
   
   ![try number issue](https://github.com/user-attachments/assets/1f6b9ecd-a9a3-4019-a15c-ba8ed56dd9cb)
   
   
   ### What you think should happen instead?
   
   Airflow should start attempt with try number 1 instead.
   
   ### How to reproduce
   
   This is happening intermittently. Not all tasks start with try number 0. I have checked to make sure both the webserver and the celery worker are on the same version 2.10.2
   
   ### Operating System
   
   SUSE Linux Enterprise Server 12 SP5
   
   ### Versions of Apache Airflow Providers
   
   apache-airflow-providers-celery==3.8.1
   celery==5.4.0
   
   
   ### Deployment
   
   Docker-Compose
   
   ### Deployment details
   
   _No response_
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Try number inconsistency between webserver and the actual log generated [airflow]

Posted by "dheerajturaga (via GitHub)" <gi...@apache.org>.
dheerajturaga commented on issue #42549:
URL: https://github.com/apache/airflow/issues/42549#issuecomment-2414831492

   @dstandish, I figured out what's happening. I had a few workers which were still on airflow 2.7.2 which never got recycled. 
   the issue went away when I upgraded them to 2.10.2
   
   Thanks for your help on triaging this!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Try number inconsistency between webserver and the actual log generated [airflow]

Posted by "dheerajturaga (via GitHub)" <gi...@apache.org>.
dheerajturaga closed issue #42549: Try number inconsistency between webserver and the actual log generated
URL: https://github.com/apache/airflow/issues/42549


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Try number inconsistency between webserver and the actual log generated [airflow]

Posted by "dstandish (via GitHub)" <gi...@apache.org>.
dstandish commented on issue #42549:
URL: https://github.com/apache/airflow/issues/42549#issuecomment-2415038091

   > @dstandish, I figured out what's happening. I had a few workers which were still on airflow 2.7.2 which never got recycled. the issue went away when I upgraded them to 2.10.2
   > 
   > Thanks for your help on triaging this!
   
   Awesome, great result


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Try number inconsistency between webserver [airflow]

Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #42549:
URL: https://github.com/apache/airflow/issues/42549#issuecomment-2379899728

   Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org