You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "KWON BYUNGCHANG (JIRA)" <ji...@apache.org> on 2016/04/03 10:33:25 UTC

[jira] [Created] (OOZIE-2499) launcher does not need distributed files, archives except jar of input/outputformat class

KWON BYUNGCHANG created OOZIE-2499:
--------------------------------------

             Summary: launcher does not need distributed files, archives except  jar of input/outputformat class
                 Key: OOZIE-2499
                 URL: https://issues.apache.org/jira/browse/OOZIE-2499
             Project: Oozie
          Issue Type: Improvement
          Components: core
            Reporter: KWON BYUNGCHANG
            Priority: Minor


In map-reduce action, when specify {{file}}, {{archives}} element,  {{JavaActionExccutor}} add it to distributed cache for configuration of launcher. 

It cause slow launching mr job.

In fact, all most launcher does not need  {{file}} , {{archives}}.  launcher need to  inputformat/outputformat class and its dependency.

I make a proposal below feature.

* add property {{oozie.launcher.distributed.cache.filter=\*.jar,\*.properties}}. default is {{*}}

* when submit launcher, filter cache files. 





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)