[jira] [Commented] (HIVE-15860) RemoteSparkJobMonitor may hang when RemoteDriver exits abnormally

["Rui Li (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-15860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859410#comment-15859410 ] 

Rui Li commented on HIVE-15860:
-------------------------------

We cannot simply extend the monitor timeout to cover {{JobSubmitted}}, otherwise we'll hit HIVE-9370 again.

> RemoteSparkJobMonitor may hang when RemoteDriver exits abnormally
> -----------------------------------------------------------------
>
>                 Key: HIVE-15860
>                 URL: https://issues.apache.org/jira/browse/HIVE-15860
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Rui Li
>            Assignee: Rui Li
>
> It happens when RemoteDriver crashes between {{JobStarted}} and {{JobSubmitted}}, e.g. killed by {{kill -9}}. RemoteSparkJobMonitor will consider the job has started, however it can't get the job info because it hasn't received the JobId. Then the monitor will loop forever.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)