You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Gerard Casas Saez (Jira)" <ji...@apache.org> on 2019/12/13 20:13:00 UTC

[jira] [Commented] (AIRFLOW-6253) Task callbacks should not happen in main scheduler thread

    [ https://issues.apache.org/jira/browse/AIRFLOW-6253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995878#comment-16995878 ] 

Gerard Casas Saez commented on AIRFLOW-6253:
--------------------------------------------

I would rephrase this as `Dag callbacks` as otherwise it can be confused with operator callbacks (which are executed in task instances)

> Task callbacks should not happen in main scheduler thread
> ---------------------------------------------------------
>
>                 Key: AIRFLOW-6253
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-6253
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: 1.10.6
>            Reporter: Dan Davydov
>            Priority: Major
>
> Currently dagrun callbacks (on_failure/on_success) happen in the main scheduler loop, which can affect or even stop scheduler performance e.g. if these callbacks hang.
>  
> These callbacks should happen in another thread with some timeout (logs for the callbacks should still be easily viewable)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)