You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Chengxiang Li (JIRA)" <ji...@apache.org> on 2014/11/18 08:21:34 UTC

[jira] [Assigned] (HIVE-8868) SparkSession and SparkClient mapping[Spark Branch]

     [ https://issues.apache.org/jira/browse/HIVE-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chengxiang Li reassigned HIVE-8868:
-----------------------------------

    Assignee: Chengxiang Li

> SparkSession and SparkClient mapping[Spark Branch]
> --------------------------------------------------
>
>                 Key: HIVE-8868
>                 URL: https://issues.apache.org/jira/browse/HIVE-8868
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Chengxiang Li
>            Assignee: Chengxiang Li
>              Labels: Spark-M3
>         Attachments: HIVE-8868.1-spark.patch
>
>
> It should be a seperate spark context for each user session, currently we share a singleton local spark context in all user sessions with local spark, and create remote spark context for each spark job with spark cluster.
> To binding one spark context to each user session, we may construct spark client on session open, one thing to notify is that, is SparkSession::conf is consist with Context::getConf? 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)