You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Denys Kuzmenko (JIRA)" <ji...@apache.org> on 2018/10/18 15:42:00 UTC
[jira] [Comment Edited] (HIVE-20737) Local SparkContext is shared
between user sessions and should be closed only when there is no active
[ https://issues.apache.org/jira/browse/HIVE-20737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655435#comment-16655435 ]
Denys Kuzmenko edited comment on HIVE-20737 at 10/18/18 3:41 PM:
-----------------------------------------------------------------
Opening/getting an opened Spark session and Job submission should be done as an atomic operation.
Not to have case when we submit something having already closed session
was (Author: dkuzmenko):
Opening of a Spark session and Job submission should be done as an atomic operation.
Not to have case when we submit something having already closed session
> Local SparkContext is shared between user sessions and should be closed only when there is no active
> ----------------------------------------------------------------------------------------------------
>
> Key: HIVE-20737
> URL: https://issues.apache.org/jira/browse/HIVE-20737
> Project: Hive
> Issue Type: Bug
> Components: Hive
> Reporter: Denys Kuzmenko
> Assignee: Denys Kuzmenko
> Priority: Major
> Attachments: HIVE-20737.1.patch, HIVE-20737.10.patch, HIVE-20737.11.patch, HIVE-20737.12.patch, HIVE-20737.2.patch, HIVE-20737.5.patch, HIVE-20737.6.patch, HIVE-20737.7.patch, HIVE-20737.8.patch, HIVE-20737.9.patch
>
>
> 1. Local SparkContext is shared between user sessions and should be closed only when there is no active.
> 2. Possible race condition in SparkSession.open() in case when user queries run in parallel within the same session.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)