You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Szehon Ho (JIRA)" <ji...@apache.org> on 2015/02/10 18:26:12 UTC

[jira] [Commented] (HIVE-9601) New Beeline queries will hang If Beeline terminates in-properly [Spark Branch]

    [ https://issues.apache.org/jira/browse/HIVE-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314489#comment-14314489 ] 

Szehon Ho commented on HIVE-9601:
---------------------------------

Some comments, this problem seems to be about orphan sessions leaving resources open, in this case the Remote Spark Application.  The orphan sessions take up resources as specified by 'spark.cores.max', 'spark.executor.memory', leaving no room for others.

The properties 'hive.server2.session.check.interval, hive.server2.idle.session.timeout' seem to help this case.  I couldn't find any other way to identify orphan sessions via Thrift and close them.

> New Beeline queries will hang If Beeline terminates in-properly [Spark Branch]
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-9601
>                 URL: https://issues.apache.org/jira/browse/HIVE-9601
>             Project: Hive
>          Issue Type: Bug
>          Components: Spark
>            Reporter: Szehon Ho
>
> User session's Spark application seems to stay around if beeline is not quit properly (!quit) because the user is not disconnected.
> If Beeline is started, it will create a new Spark application which will hang waiting for the first one.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)