You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/04/14 03:04:09 UTC

[GitHub] [airflow] sriramachegondi opened a new issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version

sriramachegondi opened a new issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version
URL: https://github.com/apache/airflow/issues/8288
 
 
   
   **Apache Airflow version**: 1.10.9
   
   **Environment**: 
   
   - **Cloud provider or hardware configuration**:
   - **OS** (e.g. from /etc/os-release): ubuntu 18.04
   - **Kernel** (e.g. `uname -a`):
   - **Install tools**:
   - **Others**:
   
   **What happened**: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version
   [log.txt](https://github.com/apache/airflow/files/4472893/log.txt)
   I notice when I tried switching celery pool option to eventlet the worker doesn’t seem to be picking up tasks.
   
   Attached the snippet of logs.
   
   <!-- (please include exact error messages if you can) -->
   
   **What you expected to happen**:
   
   <!-- What do you think went wrong? -->
   
   **How to reproduce it**: Start the airflow celery workers with Eventlet
   <!---
   
   As minimally and precisely as possible. Keep in mind we do not have access to your cluster or dags.
   
   If you are using kubernetes, please attempt to recreate the issue using minikube or kind.
   
   ## Install minikube/kind
   
   - Minikube https://minikube.sigs.k8s.io/docs/start/
   - Kind https://kind.sigs.k8s.io/docs/user/quick-start/
   
   If this is a UI bug, please provide a screenshot of the bug or a link to a youtube video of the bug in action
   
   You can include images using the .md sytle of
   ![alt text](http://url/to/img.png)
   
   To record a screencast, mac users can use QuickTime and then create an unlisted youtube video with the resulting .mov file.
   
   --->
   
   
   **Anything else we need to know**: Attached the logs
   
   <!--
   
   How often does this problem occur? Once? Every time etc?
   
   Any relevant logs to include? Put them here in side a detail tag:
   <details><summary>x.log</summary> lots of stuff </details>
   
   -->
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [airflow] khyurri edited a comment on issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version

Posted by GitBox <gi...@apache.org>.
khyurri edited a comment on issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version
URL: https://github.com/apache/airflow/issues/8288#issuecomment-613470960
 
 
   Can't reproduce at `1.10.10`. 
   
   My airflow.cfg (non default values)
   
   ```
   sql_alchemy_conn = mysql://airflow:airflow@127.0.0.1:3306/airflow
   pool = eventlet
   executor = CeleryExecutor
   broker_url = redis://redis:6379/1
   result_backend = db+mysql://airflow:airflow@127.0.0.1:3306/airflow
   ```
   
   Dag: `dags/test_dag.py`
   
   schedule_interval='*/2 * * * *'
   
   ---
   
   1. Are you running both `airflow scheduler` and `airflow worker`? 
   2. Can you send your `airflow.cfg`?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [airflow] khyurri commented on issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version

Posted by GitBox <gi...@apache.org>.
khyurri commented on issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version
URL: https://github.com/apache/airflow/issues/8288#issuecomment-613295833
 
 
   Hi, sriramachegondi
   
   I'll try to reproduce this bug

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [airflow] khyurri commented on issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version

Posted by GitBox <gi...@apache.org>.
khyurri commented on issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version
URL: https://github.com/apache/airflow/issues/8288#issuecomment-613470960
 
 
   Can't reproduce at `1.10.10`. 
   
   airflow.cfg (non default values)
   
   ```
   sql_alchemy_conn = mysql://airflow:airflow@127.0.0.1:3306/airflow
   pool = eventlet
   executor = CeleryExecutor
   broker_url = redis://redis:6379/1
   result_backend = db+mysql://airflow:airflow@127.0.0.1:3306/airflow
   ```
   
   Dag: `dags/test_dag.py`
   
   schedule_interval='*/2 * * * *'
   
   ---
   
   1. Are you running both `airflow scheduler` and `airflow worker`? 
   2. Can you send your `airflow.cfg`?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version
URL: https://github.com/apache/airflow/issues/8288#issuecomment-613200825
 
 
   Thanks for opening your first issue here! Be sure to follow the issue template!
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [airflow] turbaszek commented on issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version

Posted by GitBox <gi...@apache.org>.
turbaszek commented on issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version
URL: https://github.com/apache/airflow/issues/8288#issuecomment-614434729
 
 
   Duplicate of https://github.com/apache/airflow/issues/8023

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [airflow] turbaszek closed issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version

Posted by GitBox <gi...@apache.org>.
turbaszek closed issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version
URL: https://github.com/apache/airflow/issues/8288
 
 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services