You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ma...@apache.org on 2015/01/30 00:28:26 UTC
spark git commit: [SPARK-5429][SQL] Use javaXML plan serialization
for Hive golden answers on Hive 0.13.1
Repository: spark
Updated Branches:
refs/heads/master 715632232 -> bce0ba1fb
[SPARK-5429][SQL] Use javaXML plan serialization for Hive golden answers on Hive 0.13.1
I found that running `HiveComparisonTest.createQueryTest` to generate Hive golden answer files on Hive 0.13.1 would throw KryoException. I am not sure if this can be reproduced by others. Since Hive 0.13.0, Kryo plan serialization is introduced to replace javaXML as default plan serialization format. This is a quick fix to set hive configuration to use javaXML serialization.
Author: Liang-Chi Hsieh <vi...@gmail.com>
Closes #4223 from viirya/fix_hivetest and squashes the following commits:
97a8760 [Liang-Chi Hsieh] Use javaXML plan serialization.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/bce0ba1f
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/bce0ba1f
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/bce0ba1f
Branch: refs/heads/master
Commit: bce0ba1fbd05788f1c08549b2fd0c6a9e320a41a
Parents: 7156322
Author: Liang-Chi Hsieh <vi...@gmail.com>
Authored: Thu Jan 29 15:28:22 2015 -0800
Committer: Michael Armbrust <mi...@databricks.com>
Committed: Thu Jan 29 15:28:22 2015 -0800
----------------------------------------------------------------------
sql/hive/src/main/scala/org/apache/spark/sql/hive/TestHive.scala | 2 ++
1 file changed, 2 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/bce0ba1f/sql/hive/src/main/scala/org/apache/spark/sql/hive/TestHive.scala
----------------------------------------------------------------------
diff --git a/sql/hive/src/main/scala/org/apache/spark/sql/hive/TestHive.scala b/sql/hive/src/main/scala/org/apache/spark/sql/hive/TestHive.scala
index 822864f..7c1d113 100644
--- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/TestHive.scala
+++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/TestHive.scala
@@ -68,6 +68,8 @@ class TestHiveContext(sc: SparkContext) extends HiveContext(sc) {
System.clearProperty("spark.hostPort")
CommandProcessorFactory.clean(hiveconf)
+ hiveconf.set("hive.plan.serialization.format", "javaXML")
+
lazy val warehousePath = getTempFilePath("sparkHiveWarehouse").getCanonicalPath
lazy val metastorePath = getTempFilePath("sparkHiveMetastore").getCanonicalPath
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org