[jira] [Commented] (SPARK-11869) ML test TempDirectory trait does not clean up properly

["Joseph K. Bradley (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-11869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15014807#comment-15014807 ] 

Joseph K. Bradley commented on SPARK-11869:
-------------------------------------------

It's because {{TempDirectory.afterAll}} needs to delete {{tempDir.parent}}, not just {{tempDir}}.

> ML test TempDirectory trait does not clean up properly
> ------------------------------------------------------
>
>                 Key: SPARK-11869
>                 URL: https://issues.apache.org/jira/browse/SPARK-11869
>             Project: Spark
>          Issue Type: Bug
>          Components: ML
>    Affects Versions: 1.6.0
>            Reporter: Joseph K. Bradley
>            Assignee: Joseph K. Bradley
>
> org.apache.spark.ml.util.TempDirectory should remove the temp directories it creates, but it does not (at least not locally on my machine).
> This is an issue for the several new tests for ML model import/export, which leave a bunch of empty temp directories.
> At first inspection, I don't see why this problem is occurring.  It must mean that {{org.apache.spark.util.Utils.deleteRecursively}} is successful except for its {{finally}} section.  That section is tested in UtilsSuite unit tests, so it should be working.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org