You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by li...@apache.org on 2016/01/19 21:24:31 UTC

spark git commit: [SPARK-12560][SQL] SqlTestUtils.stripSparkFilter needs to copy utf8strings

Repository: spark
Updated Branches:
  refs/heads/master b72e01e82 -> 4dbd31612


[SPARK-12560][SQL] SqlTestUtils.stripSparkFilter needs to copy utf8strings

See https://issues.apache.org/jira/browse/SPARK-12560

This isn't causing any problems currently because the tests for string predicate pushdown are currently disabled.  I ran into this while trying to turn them back on with a different version of parquet.  Figure it was good to fix now in any case.

Author: Imran Rashid <ir...@cloudera.com>

Closes #10510 from squito/SPARK-12560.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4dbd3161
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/4dbd3161
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/4dbd3161

Branch: refs/heads/master
Commit: 4dbd3161227a32736105cef624f9df21650a359c
Parents: b72e01e
Author: Imran Rashid <ir...@cloudera.com>
Authored: Tue Jan 19 12:24:21 2016 -0800
Committer: Cheng Lian <li...@databricks.com>
Committed: Tue Jan 19 12:24:21 2016 -0800

----------------------------------------------------------------------
 .../src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala    | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/4dbd3161/sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala
----------------------------------------------------------------------
diff --git a/sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala b/sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala
index 7df344e..5f73d71 100644
--- a/sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala
+++ b/sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala
@@ -189,7 +189,7 @@ private[sql] trait SQLTestUtils
       .executedPlan.asInstanceOf[org.apache.spark.sql.execution.Filter]
       .child
       .execute()
-      .map(row => Row.fromSeq(row.toSeq(schema)))
+      .map(row => Row.fromSeq(row.copy().toSeq(schema)))
 
     sqlContext.createDataFrame(childRDD, schema)
   }


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org