You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2022/02/03 10:23:00 UTC

[jira] [Assigned] (HADOOP-15789) DistCp does not clean staging folder if class extends DistCp

     [ https://issues.apache.org/jira/browse/HADOOP-15789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steve Loughran reassigned HADOOP-15789:
---------------------------------------

    Assignee: Lawrence Andrews

> DistCp does not clean staging folder if class extends DistCp
> ------------------------------------------------------------
>
>                 Key: HADOOP-15789
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15789
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: tools/distcp
>            Reporter: Lawrence Andrews
>            Assignee: Lawrence Andrews
>            Priority: Minor
>         Attachments: HADOOP-15789-01.patch
>
>
> My code extends Distcp class and for some reason if distcp fails staging folder is not delete and this staging folder piles up occupying space on hdfs.
> After checking the code i found that cleanup() function is private. Making the cleanup() method as public, user should be able to invoke the cleanup if job fails.
> This works fine with command line argument. But fails only if we extend Distcp class.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org