[jira] [Created] (SPARK-15887) Bring back the hive-site.xml support for Spark 2.0

["Wenchen Fan (JIRA)" <ji...@apache.org>]

Wenchen Fan created SPARK-15887:
-----------------------------------

             Summary: Bring back the hive-site.xml support for Spark 2.0
                 Key: SPARK-15887
                 URL: https://issues.apache.org/jira/browse/SPARK-15887
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.0.0
            Reporter: Wenchen Fan
            Assignee: Wenchen Fan


Right now, Spark 2.0 does not load hive-site.xml. Based on users' feedback, it seems make sense to still load this conf file.
Originally, this file was loaded when we load HiveConf class and all settings can be retrieved after we create a HiveConf instances. Let's avoid of using this way to load hive-site.xml. Instead, since hive-site.xml is a normal hadoop conf file, we can first find its url using the classloader and then use Hadoop Configuration's addResource (or add hive-site.xml as a default resource through Configuration.addDefaultResource) to load confs.
Please note that hive-site.xml needs to be loaded into the hadoop conf used to create metadataHive.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org