You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/04/14 03:04:09 UTC
[GitHub] [airflow] sriramachegondi opened a new issue #8288: Eventlet with
CeleryExecutor not working in Airflow 1.10.9 version
sriramachegondi opened a new issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version
URL: https://github.com/apache/airflow/issues/8288
**Apache Airflow version**: 1.10.9
**Environment**:
- **Cloud provider or hardware configuration**:
- **OS** (e.g. from /etc/os-release): ubuntu 18.04
- **Kernel** (e.g. `uname -a`):
- **Install tools**:
- **Others**:
**What happened**: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version
[log.txt](https://github.com/apache/airflow/files/4472893/log.txt)
I notice when I tried switching celery pool option to eventlet the worker doesn’t seem to be picking up tasks.
Attached the snippet of logs.
<!-- (please include exact error messages if you can) -->
**What you expected to happen**:
<!-- What do you think went wrong? -->
**How to reproduce it**: Start the airflow celery workers with Eventlet
<!---
As minimally and precisely as possible. Keep in mind we do not have access to your cluster or dags.
If you are using kubernetes, please attempt to recreate the issue using minikube or kind.
## Install minikube/kind
- Minikube https://minikube.sigs.k8s.io/docs/start/
- Kind https://kind.sigs.k8s.io/docs/user/quick-start/
If this is a UI bug, please provide a screenshot of the bug or a link to a youtube video of the bug in action
You can include images using the .md sytle of
![alt text](http://url/to/img.png)
To record a screencast, mac users can use QuickTime and then create an unlisted youtube video with the resulting .mov file.
--->
**Anything else we need to know**: Attached the logs
<!--
How often does this problem occur? Once? Every time etc?
Any relevant logs to include? Put them here in side a detail tag:
<details><summary>x.log</summary> lots of stuff </details>
-->
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [airflow] khyurri edited a comment on issue #8288: Eventlet with
CeleryExecutor not working in Airflow 1.10.9 version
Posted by GitBox <gi...@apache.org>.
khyurri edited a comment on issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version
URL: https://github.com/apache/airflow/issues/8288#issuecomment-613470960
Can't reproduce at `1.10.10`.
My airflow.cfg (non default values)
```
sql_alchemy_conn = mysql://airflow:airflow@127.0.0.1:3306/airflow
pool = eventlet
executor = CeleryExecutor
broker_url = redis://redis:6379/1
result_backend = db+mysql://airflow:airflow@127.0.0.1:3306/airflow
```
Dag: `dags/test_dag.py`
schedule_interval='*/2 * * * *'
---
1. Are you running both `airflow scheduler` and `airflow worker`?
2. Can you send your `airflow.cfg`?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [airflow] khyurri commented on issue #8288: Eventlet with
CeleryExecutor not working in Airflow 1.10.9 version
Posted by GitBox <gi...@apache.org>.
khyurri commented on issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version
URL: https://github.com/apache/airflow/issues/8288#issuecomment-613295833
Hi, sriramachegondi
I'll try to reproduce this bug
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [airflow] khyurri commented on issue #8288: Eventlet with
CeleryExecutor not working in Airflow 1.10.9 version
Posted by GitBox <gi...@apache.org>.
khyurri commented on issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version
URL: https://github.com/apache/airflow/issues/8288#issuecomment-613470960
Can't reproduce at `1.10.10`.
airflow.cfg (non default values)
```
sql_alchemy_conn = mysql://airflow:airflow@127.0.0.1:3306/airflow
pool = eventlet
executor = CeleryExecutor
broker_url = redis://redis:6379/1
result_backend = db+mysql://airflow:airflow@127.0.0.1:3306/airflow
```
Dag: `dags/test_dag.py`
schedule_interval='*/2 * * * *'
---
1. Are you running both `airflow scheduler` and `airflow worker`?
2. Can you send your `airflow.cfg`?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [airflow] boring-cyborg[bot] commented on issue #8288: Eventlet
with CeleryExecutor not working in Airflow 1.10.9 version
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version
URL: https://github.com/apache/airflow/issues/8288#issuecomment-613200825
Thanks for opening your first issue here! Be sure to follow the issue template!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [airflow] turbaszek commented on issue #8288: Eventlet with
CeleryExecutor not working in Airflow 1.10.9 version
Posted by GitBox <gi...@apache.org>.
turbaszek commented on issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version
URL: https://github.com/apache/airflow/issues/8288#issuecomment-614434729
Duplicate of https://github.com/apache/airflow/issues/8023
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [airflow] turbaszek closed issue #8288: Eventlet with
CeleryExecutor not working in Airflow 1.10.9 version
Posted by GitBox <gi...@apache.org>.
turbaszek closed issue #8288: Eventlet with CeleryExecutor not working in Airflow 1.10.9 version
URL: https://github.com/apache/airflow/issues/8288
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services