[jira] [Updated] (HIVE-8868) SparkSession and SparkClient mapping[Spark Branch]

["Chengxiang Li (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chengxiang Li updated HIVE-8868:
--------------------------------
    Attachment: HIVE-8868.1-spark.patch

For local spark context, multi user would share the same spark context, so does the configurations, we should note that to users in document.

> SparkSession and SparkClient mapping[Spark Branch]
> --------------------------------------------------
>
>                 Key: HIVE-8868
>                 URL: https://issues.apache.org/jira/browse/HIVE-8868
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Chengxiang Li
>              Labels: Spark-M3
>         Attachments: HIVE-8868.1-spark.patch
>
>
> It should be a seperate spark context for each user session, currently we share a singleton local spark context in all user sessions with local spark, and create remote spark context for each spark job with spark cluster.
> To binding one spark context to each user session, we may construct spark client on session open, one thing to notify is that, is SparkSession::conf is consist with Context::getConf? 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)