[jira] [Resolved] (SPARK-20689) python doctest leaking bucketed table

["Xiao Li (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-20689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xiao Li resolved SPARK-20689.
-----------------------------
       Resolution: Fixed
    Fix Version/s: 2.3.0

> python doctest leaking bucketed table
> -------------------------------------
>
>                 Key: SPARK-20689
>                 URL: https://issues.apache.org/jira/browse/SPARK-20689
>             Project: Spark
>          Issue Type: Bug
>          Components: PySpark, SQL
>    Affects Versions: 2.3.0
>            Reporter: Felix Cheung
>            Assignee: Felix Cheung
>             Fix For: 2.3.0
>
>
> When trying to address build test failure in SPARK-20661 we discovered some tables are unexpectedly left behind causing R tests to fail. While we changed the R tests to be more resilient, we investigated further to see what was creating those tables.
> It turns out pyspark doctest is calling saveAsTable without ever dropping them. Since we have separate python tests for bucketed table, and we don't check for result in doctest, there is really no need to run the doctest 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org