You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/10/17 21:39:33 UTC

[GitHub] [airflow] turbaszek opened a new issue #11622: airflow celery worker -D does not process tasks

turbaszek opened a new issue #11622:
URL: https://github.com/apache/airflow/issues/11622


   **Apache Airflow version**:
   2.0 (master)
   
   **Environment**:
   
   ```
   ./breeze --python 3.7 --db-reset restart --integration redis
   ```
   
   **What happened**:
   
   Running `airflow celery worker -D` spawns celery worker (`ps -aux`) but the worker does not consume any tasks 👀 
   
   **What you expected to happen**:
   
   I expect that demonized worker will consume Airflow tasks.
   
   **How to reproduce it**:
   ```
   ./breeze --python 3.7 --db-reset restart --integration redis
   airflow scheduler -D
   airflow webserver -D -w 1
   airflow celery worker -c 1 -D
   ```
   Then trigger any DAG from webui.
   
   
   **Anything else we need to know**:
   
   Possibly related to #11336 (but I need to check)
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] ashb commented on issue #11622: airflow celery worker -D does not process tasks

Posted by GitBox <gi...@apache.org>.
ashb commented on issue #11622:
URL: https://github.com/apache/airflow/issues/11622#issuecomment-988799350


   That was Celery 5.0.1, which is has been out for a long time.
   Are you seeing the exact same error mesxsage @wyk-qyf ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] turbaszek removed a comment on issue #11622: airflow celery worker -D does not process tasks

Posted by GitBox <gi...@apache.org>.
turbaszek removed a comment on issue #11622:
URL: https://github.com/apache/airflow/issues/11622#issuecomment-711096916


   Oh, seems to be faced in Airflow before: https://github.com/celery/celery/issues/3932#issuecomment-310164246


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] thedrow commented on issue #11622: airflow celery worker -D does not process tasks

Posted by GitBox <gi...@apache.org>.
thedrow commented on issue #11622:
URL: https://github.com/apache/airflow/issues/11622#issuecomment-711258146


   Released. Please try again. 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] thedrow commented on issue #11622: airflow celery worker -D does not process tasks

Posted by GitBox <gi...@apache.org>.
thedrow commented on issue #11622:
URL: https://github.com/apache/airflow/issues/11622#issuecomment-711136093


   Please wait for the 5.0.1 release today.
   It fixes this issue.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] turbaszek commented on issue #11622: airflow celery worker -D does not process tasks

Posted by GitBox <gi...@apache.org>.
turbaszek commented on issue #11622:
URL: https://github.com/apache/airflow/issues/11622#issuecomment-711101081


   After a few hours I have no idea why it does not work 🤷‍♂️ I suppose we can revert the #11336, any opinions/ideas? @kaxil @mik-laj @auvipy @thedrow


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] wyk-qyf commented on issue #11622: airflow celery worker -D does not process tasks

Posted by GitBox <gi...@apache.org>.
wyk-qyf commented on issue #11622:
URL: https://github.com/apache/airflow/issues/11622#issuecomment-988694214


   > Please wait for the 5.0.1 release today. It fixes this issue.
   
   what is the meaning of 5.0.1,is this a airflow version number?I am facing this problem too。how to solve it?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] turbaszek commented on issue #11622: airflow celery worker -D does not process tasks

Posted by GitBox <gi...@apache.org>.
turbaszek commented on issue #11622:
URL: https://github.com/apache/airflow/issues/11622#issuecomment-711096916


   Oh, seems to be faced in Airflow before: https://github.com/celery/celery/issues/3932#issuecomment-310164246


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] turbaszek closed issue #11622: airflow celery worker -D does not process tasks

Posted by GitBox <gi...@apache.org>.
turbaszek closed issue #11622:
URL: https://github.com/apache/airflow/issues/11622


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org