You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2016/05/27 20:04:12 UTC
[jira] [Updated] (OOZIE-2475) Oozie does not cleanup action dir of
killed actions
[ https://issues.apache.org/jira/browse/OOZIE-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated OOZIE-2475:
--------------------------------------
Description:
There is corner case where leaking happens.
when workflow KillCommand is issued, WfEndXCommand is invoked in the end finally block, and WfEndXCommand.deleteWFDir() kills action Dir (e.g., /user/satish/oozie_satish/123450-15000000000000-oozie_satish-W)
but, when this happens right before launcher mapper uploading actionData to HDFS, previously deleted actionDir is created again. the actionDir will not be cleaned up after. This leak can fill up namespace quota of user over a period of time.
The solution is to delete clean up action dir in ActionKillXCommand.
was:
There is corner case where leaking happens.
when workflow KillCommand is issued, WfEndXCommand is invoked in the end finally block, and WfEndXCommand.deleteWFDir() kills action Dir (e.g., /user/satish/oozie_satish/123450-15000000000000-oozie_satish-W)
but, when this happens right before launcher mapper uploading actionData to HDFS, previously deleted actionDir is created again. the actionDir will not be cleaned up after.
The solution is to delete clean up action dir in ActionKillXCommand.
Summary: Oozie does not cleanup action dir of killed actions (was: Oozie does not cleanup failed actions; fills up namespace quota)
> Oozie does not cleanup action dir of killed actions
> ---------------------------------------------------
>
> Key: OOZIE-2475
> URL: https://issues.apache.org/jira/browse/OOZIE-2475
> Project: Oozie
> Issue Type: Bug
> Reporter: Satish Subhashrao Saley
> Assignee: Satish Subhashrao Saley
> Attachments: OOZIE-2475-1.patch
>
>
> There is corner case where leaking happens.
> when workflow KillCommand is issued, WfEndXCommand is invoked in the end finally block, and WfEndXCommand.deleteWFDir() kills action Dir (e.g., /user/satish/oozie_satish/123450-15000000000000-oozie_satish-W)
> but, when this happens right before launcher mapper uploading actionData to HDFS, previously deleted actionDir is created again. the actionDir will not be cleaned up after. This leak can fill up namespace quota of user over a period of time.
> The solution is to delete clean up action dir in ActionKillXCommand.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)