[jira] [Resolved] (AIRFLOW-5035) Dag parsing process can leave orphan processes under heavy load

["Ash Berlin-Taylor (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/AIRFLOW-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ash Berlin-Taylor resolved AIRFLOW-5035.
----------------------------------------
    Resolution: Fixed

> Dag parsing process can leave orphan processes under heavy load
> ---------------------------------------------------------------
>
>                 Key: AIRFLOW-5035
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5035
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 1.10.4
>            Reporter: Ash Berlin-Taylor
>            Assignee: Ash Berlin-Taylor
>            Priority: Blocker
>             Fix For: 1.10.4
>
>
> As reported by James Meickle on the mailing list, under certain cases it is possible that the multiprocessing.Manager process can end up orphaned when the scheduler shuts down.
> This is relating to a new merge in 1.10.4 (i.e. 1.10.3 wasn't affected)
> The "orphan" process is massively exasperated but having a {{--run-duration 600}}, but we should try and fix this if we can.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)