You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ma...@apache.org on 2015/06/18 00:29:52 UTC
spark git commit: [SPARK-8397] [SQL] Allow custom configuration for
TestHive
Repository: spark
Updated Branches:
refs/heads/master a06d9c8e7 -> d1069cba4
[SPARK-8397] [SQL] Allow custom configuration for TestHive
We encourage people to use TestHive in unit tests, because it's
impossible to create more than one HiveContext within one process. The
current implementation locks people into using a local[2] SparkContext
underlying their HiveContext. We should make it possible to override
this using a system property so that people can test against
local-cluster or remote spark clusters to make their tests more
realistic.
Author: Punya Biswal <pb...@palantir.com>
Closes #6844 from punya/feature/SPARK-8397 and squashes the following commits:
97ef394 [Punya Biswal] [SPARK-8397][SQL] Allow custom configuration for TestHive
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d1069cba
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d1069cba
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d1069cba
Branch: refs/heads/master
Commit: d1069cba4a2eb4f00fc3306993a49284efad00c7
Parents: a06d9c8
Author: Punya Biswal <pb...@palantir.com>
Authored: Wed Jun 17 15:29:39 2015 -0700
Committer: Michael Armbrust <mi...@databricks.com>
Committed: Wed Jun 17 15:29:39 2015 -0700
----------------------------------------------------------------------
.../src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/d1069cba/sql/hive/src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala
----------------------------------------------------------------------
diff --git a/sql/hive/src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala b/sql/hive/src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala
index 7c7afc8..9215509 100644
--- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala
+++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala
@@ -49,7 +49,7 @@ import scala.collection.JavaConversions._
object TestHive
extends TestHiveContext(
new SparkContext(
- "local[2]",
+ System.getProperty("spark.sql.test.master", "local[2]"),
"TestSQLContext",
new SparkConf()
.set("spark.sql.test", "")
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org