You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Ryota Egashira (JIRA)" <ji...@apache.org> on 2015/01/13 00:19:34 UTC

[jira] [Updated] (OOZIE-2110) cancel delegation token of launcher jobs that stay till child jobs finish

     [ https://issues.apache.org/jira/browse/OOZIE-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ryota Egashira updated OOZIE-2110:
----------------------------------
    Attachment: OOZIE-2110.patch

> cancel delegation token of launcher jobs that stay till child jobs finish
> -------------------------------------------------------------------------
>
>                 Key: OOZIE-2110
>                 URL: https://issues.apache.org/jira/browse/OOZIE-2110
>             Project: Oozie
>          Issue Type: Bug
>    Affects Versions: trunk
>            Reporter: Ryota Egashira
>            Assignee: Ryota Egashira
>             Fix For: trunk
>
>         Attachments: OOZIE-2110.patch
>
>
> set mapreduce.job.complete.cancel.delegation.tokens=true for launcher job that wait for child jobs to finish (most of actions, pig,hive,java, distcp, etc). this is currently set to false.
> keep mapreduce.job.complete.cancel.delegation.tokens=false for launcher job that exits right after a child job launched (mapred action), such that it does not delete delegation token while child job still running.
> this change reduce the load on Namenode in terms of the number of tokens it has to maintain. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)