You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/06/19 17:44:00 UTC
[jira] [Resolved] (SPARK-24521) Fix ineffective test in
CachedTableSuite
[ https://issues.apache.org/jira/browse/SPARK-24521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xiao Li resolved SPARK-24521.
-----------------------------
Resolution: Fixed
Fix Version/s: 2.4.0
2.3.2
> Fix ineffective test in CachedTableSuite
> ----------------------------------------
>
> Key: SPARK-24521
> URL: https://issues.apache.org/jira/browse/SPARK-24521
> Project: Spark
> Issue Type: Test
> Components: SQL
> Affects Versions: 2.3.1
> Reporter: Li Jin
> Assignee: Li Jin
> Priority: Minor
> Fix For: 2.3.2, 2.4.0
>
>
> test("withColumn doesn't invalidate cached dataframe") in CachedTableSuite doesn't not work because:
> The UDF is executed and test count incremented when "df.cache()" is called and the subsequent "df.collect()" has no effect on the test result.
> link:
> https://github.com/apache/spark/blob/master/sql/core/src/test/scala/org/apache/spark/sql/CachedTableSuite.scala#L86
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org