You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/04/08 13:47:51 UTC

[GitHub] [airflow] zachary-naylor commented on issue #15116: Logging to S3 fails using eventlet workers (maximum recursion depth exceeded)

zachary-naylor commented on issue #15116:
URL: https://github.com/apache/airflow/issues/15116#issuecomment-815839510


   It would appear they heard you; Flask's PR 3412 has since been merged with the asyncio support.
   
   I have been trialing several env vars and setting ```AIRFLOW__CORE__EXECUTE_TASKS_NEW_PYTHON_INTERPRETER: 'True'``` results in the recursion errors disappearing with eventlet worker tasks executing; suggesting an issue around the ```celery_executor._execute_in_fork``` function.
   
   However, whilst eventlet workers are now running the tasks without recursion errors, the tasks are executed sequentially and not asynchronously - defeating the purpose of using eventlet in the first place.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org