You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2019/10/08 05:45:10 UTC

[jira] [Resolved] (SPARK-23322) Launcher handles can miss application updates if application finishes too quickly

     [ https://issues.apache.org/jira/browse/SPARK-23322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon resolved SPARK-23322.
----------------------------------
    Resolution: Incomplete

> Launcher handles can miss application updates if application finishes too quickly
> ---------------------------------------------------------------------------------
>
>                 Key: SPARK-23322
>                 URL: https://issues.apache.org/jira/browse/SPARK-23322
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 2.3.0
>            Reporter: Marcelo Masiero Vanzin
>            Priority: Minor
>              Labels: bulk-closed
>
> This is the underlying issue in SPARK-23020, which was worked around in our tests, but still exist in the code.
> If a child application finishes too quickly, the launcher code may clean up the handle's state before the connection from the child has been acknowledged. This means than the application handle will have a final state LOST instead of whatever final state the application sent.
> This doesn't seem to affect child processes as much as the new in-process launch mode, and it requires the child application to finish very quickly, which should be rare for the kind of use case the launcher library covers.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org