You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2017/05/10 06:29:04 UTC

[jira] [Commented] (SPARK-20689) python doctest leaking bucketed table

    [ https://issues.apache.org/jira/browse/SPARK-20689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16004149#comment-16004149 ] 

Apache Spark commented on SPARK-20689:
--------------------------------------

User 'felixcheung' has created a pull request for this issue:
https://github.com/apache/spark/pull/17932

> python doctest leaking bucketed table
> -------------------------------------
>
>                 Key: SPARK-20689
>                 URL: https://issues.apache.org/jira/browse/SPARK-20689
>             Project: Spark
>          Issue Type: Bug
>          Components: PySpark, SQL
>    Affects Versions: 2.3.0
>            Reporter: Felix Cheung
>            Assignee: Felix Cheung
>
> When trying to address build test failure in SPARK-20661 we discovered some tables are unexpectedly left behind causing R tests to fail. While we changed the R tests to be more resilient, we investigated further to see what was creating those tables.
> It turns out pyspark doctest is calling saveAsTable without ever dropping them. Since we have separately python tests for bucketed table, and there is not testing of results, there is really no need to run the doctest 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org