[jira] [Created] (SPARK-11208) Filter out 'hive.metastore.rawstore.impl' from executionHive temporary config

["Artem Aliev (JIRA)" <ji...@apache.org>]

Artem Aliev created SPARK-11208:
-----------------------------------

             Summary: Filter out 'hive.metastore.rawstore.impl' from executionHive temporary config
                 Key: SPARK-11208
                 URL: https://issues.apache.org/jira/browse/SPARK-11208
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 1.5.1, 1.6.0
            Reporter: Artem Aliev


Spark use two hive meta stores: external one for storing tables and internal one (executionHive):
{code}
/**
The copy of the hive client that is used for execution. Currently this must always be
Hive 13 as this is the version of Hive that is packaged with Spark SQL. This copy of the
client is used for execution related tasks like registering temporary functions or ensuring
that the ThreadLocal SessionState is correctly populated. This copy of Hive is not used
for storing persistent metadata, and only point to a dummy metastore in a temporary directory. */
{code}
The executionHive assumed to be a standard meta store located in temporary directory as a derby db. But hive.metastore.rawstore.impl was not filtered out so any custom implementation of the metastore with other storage properties (not JDO) will persist that temporary functions. CassandraMetaStore from DataStax Enterprise is one of examples.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org