You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Ryota Egashira (JIRA)" <ji...@apache.org> on 2015/01/13 00:19:34 UTC
[jira] [Updated] (OOZIE-2110) cancel delegation token of launcher
jobs that stay till child jobs finish
[ https://issues.apache.org/jira/browse/OOZIE-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ryota Egashira updated OOZIE-2110:
----------------------------------
Attachment: OOZIE-2110.patch
> cancel delegation token of launcher jobs that stay till child jobs finish
> -------------------------------------------------------------------------
>
> Key: OOZIE-2110
> URL: https://issues.apache.org/jira/browse/OOZIE-2110
> Project: Oozie
> Issue Type: Bug
> Affects Versions: trunk
> Reporter: Ryota Egashira
> Assignee: Ryota Egashira
> Fix For: trunk
>
> Attachments: OOZIE-2110.patch
>
>
> set mapreduce.job.complete.cancel.delegation.tokens=true for launcher job that wait for child jobs to finish (most of actions, pig,hive,java, distcp, etc). this is currently set to false.
> keep mapreduce.job.complete.cancel.delegation.tokens=false for launcher job that exits right after a child job launched (mapred action), such that it does not delete delegation token while child job still running.
> this change reduce the load on Namenode in terms of the number of tokens it has to maintain.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)