You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Dan Davydov (Jira)" <ji...@apache.org> on 2019/12/13 15:10:00 UTC

[jira] [Created] (AIRFLOW-6253) Task callbacks should not happen in main scheduler thread

Dan Davydov created AIRFLOW-6253:
------------------------------------

             Summary: Task callbacks should not happen in main scheduler thread
                 Key: AIRFLOW-6253
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-6253
             Project: Apache Airflow
          Issue Type: Bug
          Components: scheduler
    Affects Versions: 1.10.6
            Reporter: Dan Davydov


Currently dagrun callbacks (on_failure/on_success) happen in the main scheduler loop, which can affect or even stop scheduler performance e.g. if these callbacks hang.

 

These callbacks should happen in another thread with some timeout (logs for the callbacks should still be easily viewable)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)