You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/06/09 10:57:43 UTC

[GitHub] [airflow] anitakar commented on issue #10790: Copy of [AIRFLOW-5071] JIRA: Thousands of Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally?

anitakar commented on issue #10790:
URL: https://github.com/apache/airflow/issues/10790#issuecomment-857597589


   > Hello. I am using airflow 2.0 and just ran into this error.
   > 
   > How can I fix it??
   
   Just summarising what others have reported worked for them:
   1. Set worker_concurrency to match the CPU number and worker_autoscale to "4,2".
   2. Increase the poke_interval value for the sensors to 5 minutes (from the default 1 minute).
   3. Reduce the scheduler looping time(dag processing time, etc) or increase the sensor task reschedule.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org