You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yin Huai (JIRA)" <ji...@apache.org> on 2016/05/20 21:25:13 UTC

[jira] [Created] (SPARK-15455) For IsolatedClientLoader, we need to provide a conf to disable sharing Hadoop classes

Yin Huai created SPARK-15455:
--------------------------------

             Summary: For IsolatedClientLoader, we need to provide a conf to disable sharing Hadoop classes
                 Key: SPARK-15455
                 URL: https://issues.apache.org/jira/browse/SPARK-15455
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.0.0
            Reporter: Yin Huai
            Assignee: Yin Huai


Right now, we always share Hadoop classes between Spark side and the metastore client side (HiveClientImpl). However, it is possible that the Hadoop used by the metastore client is in a different version of Hadoop. Thus, in this case, we cannot share Hadoop classes. Once we disable sharing Hadoop classes, we cannot pass a Hadoop Configuration to HiveClientImpl because Configuration will be loaded by different classloaders.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org