You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/02 17:58:02 UTC

[jira] [Assigned] (AIRFLOW-1386) Add a SLEEP state for sensors

     [ https://issues.apache.org/jira/browse/AIRFLOW-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned AIRFLOW-1386:
-------------------------------------

    Assignee: Holden Karau's magical unicorn

> Add a SLEEP state for sensors
> -----------------------------
>
>                 Key: AIRFLOW-1386
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1386
>             Project: Apache Airflow
>          Issue Type: Wish
>          Components: scheduler
>            Reporter: Yong-Siang Shih
>            Assignee: Holden Karau's magical unicorn
>            Priority: Minor
>
> Currently when the sensor is sleeping, the task process is in RUNING state and it still consumes resources such as memory (because the process does not terminate). This is waste of resource, especially when there are thousands of sensors sleeping and poking. Preferably when it sleeps, it would enter a SLEEP state and terminate, waiting for scheduler to reschedule it.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)