You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by li...@apache.org on 2017/08/19 18:41:37 UTC
spark git commit: [SPARK-21790][TESTS] Fix Docker-based Integration
Test errors.
Repository: spark
Updated Branches:
refs/heads/master 10be01848 -> 72b738d8d
[SPARK-21790][TESTS] Fix Docker-based Integration Test errors.
## What changes were proposed in this pull request?
[SPARK-17701](https://github.com/apache/spark/pull/18600/files#diff-b9f96d092fb3fea76bcf75e016799678L77) removed `metadata` function, this PR removed the Docker-based Integration module that has been relevant to `SparkPlan.metadata`.
## How was this patch tested?
manual tests
Author: Yuming Wang <wg...@gmail.com>
Closes #19000 from wangyum/SPARK-21709.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/72b738d8
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/72b738d8
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/72b738d8
Branch: refs/heads/master
Commit: 72b738d8dcdb7893003c81bf1c73bbe262852d1a
Parents: 10be018
Author: Yuming Wang <wg...@gmail.com>
Authored: Sat Aug 19 11:41:32 2017 -0700
Committer: gatorsmile <ga...@gmail.com>
Committed: Sat Aug 19 11:41:32 2017 -0700
----------------------------------------------------------------------
external/docker-integration-tests/pom.xml | 7 +++++++
.../org/apache/spark/sql/jdbc/OracleIntegrationSuite.scala | 9 ---------
2 files changed, 7 insertions(+), 9 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/72b738d8/external/docker-integration-tests/pom.xml
----------------------------------------------------------------------
diff --git a/external/docker-integration-tests/pom.xml b/external/docker-integration-tests/pom.xml
index 0fa87a6..485b562 100644
--- a/external/docker-integration-tests/pom.xml
+++ b/external/docker-integration-tests/pom.xml
@@ -82,6 +82,13 @@
</dependency>
<dependency>
<groupId>org.apache.spark</groupId>
+ <artifactId>spark-catalyst_${scala.binary.version}</artifactId>
+ <version>${project.version}</version>
+ <type>test-jar</type>
+ <scope>test</scope>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.spark</groupId>
<artifactId>spark-sql_${scala.binary.version}</artifactId>
<version>${project.version}</version>
<scope>test</scope>
http://git-wip-us.apache.org/repos/asf/spark/blob/72b738d8/external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/OracleIntegrationSuite.scala
----------------------------------------------------------------------
diff --git a/external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/OracleIntegrationSuite.scala b/external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/OracleIntegrationSuite.scala
index e14810a..80a129a 100644
--- a/external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/OracleIntegrationSuite.scala
+++ b/external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/OracleIntegrationSuite.scala
@@ -255,15 +255,6 @@ class OracleIntegrationSuite extends DockerJDBCIntegrationSuite with SharedSQLCo
val df = dfRead.filter(dfRead.col("date_type").lt(dt))
.filter(dfRead.col("timestamp_type").lt(ts))
- val metadata = df.queryExecution.sparkPlan.metadata
- // The "PushedFilters" part should be exist in Datafrome's
- // physical plan and the existence of right literals in
- // "PushedFilters" is used to prove that the predicates
- // pushing down have been effective.
- assert(metadata.get("PushedFilters").ne(None))
- assert(metadata("PushedFilters").contains(dt.toString))
- assert(metadata("PushedFilters").contains(ts.toString))
-
val row = df.collect()(0)
assert(row.getDate(0).equals(dateVal))
assert(row.getTimestamp(1).equals(timestampVal))
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org