You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Xuefu Zhang (JIRA)" <ji...@apache.org> on 2017/06/26 17:08:00 UTC

[jira] [Created] (HIVE-16961) Hive on Spark leaks spark application in case user cancels query and closes session

Xuefu Zhang created HIVE-16961:
----------------------------------

             Summary: Hive on Spark leaks spark application in case user cancels query and closes session
                 Key: HIVE-16961
                 URL: https://issues.apache.org/jira/browse/HIVE-16961
             Project: Hive
          Issue Type: Bug
          Components: Spark
    Affects Versions: 1.1.0
            Reporter: Xuefu Zhang
            Assignee: Xuefu Zhang


It's found that a Spark application is leaked when user cancels query and closes the session while Hive is waiting for remote driver to connect back. This is found for asynchronous query execution, but seemingly equally applicable for synchronous submission when session is abruptly closed. The leaked Spark application that runs Spark driver connects back to Hive successfully and run for ever (until HS2 restarts), but receives no job submission because the session is already closed. Ideally, Hive should rejects the connection from the driver so the driver will exist.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)