You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Ash Berlin-Taylor (JIRA)" <ji...@apache.org> on 2019/07/24 14:52:00 UTC

[jira] [Created] (AIRFLOW-5035) Dag parsing process can leave orphan processes under heavy load

Ash Berlin-Taylor created AIRFLOW-5035:
------------------------------------------

             Summary: Dag parsing process can leave orphan processes under heavy load
                 Key: AIRFLOW-5035
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5035
             Project: Apache Airflow
          Issue Type: Bug
          Components: core
    Affects Versions: 1.10.4
            Reporter: Ash Berlin-Taylor
            Assignee: Ash Berlin-Taylor
             Fix For: 1.10.4


As reported by James Meickle on the mailing list, under certain cases it is possible that the multiprocessing.Manager process can end up orphaned when the scheduler shuts down.

This is relating to a new merge in 1.10.4 (i.e. 1.10.3 wasn't affected)

The "orphan" process is massively exasperated but having a {{--run-duration 600}}, but we should try and fix this if we can.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)