You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "KWON BYUNGCHANG (JIRA)" <ji...@apache.org> on 2016/04/03 10:33:25 UTC
[jira] [Created] (OOZIE-2499) launcher does not need distributed
files, archives except jar of input/outputformat class
KWON BYUNGCHANG created OOZIE-2499:
--------------------------------------
Summary: launcher does not need distributed files, archives except jar of input/outputformat class
Key: OOZIE-2499
URL: https://issues.apache.org/jira/browse/OOZIE-2499
Project: Oozie
Issue Type: Improvement
Components: core
Reporter: KWON BYUNGCHANG
Priority: Minor
In map-reduce action, when specify {{file}}, {{archives}} element, {{JavaActionExccutor}} add it to distributed cache for configuration of launcher.
It cause slow launching mr job.
In fact, all most launcher does not need {{file}} , {{archives}}. launcher need to inputformat/outputformat class and its dependency.
I make a proposal below feature.
* add property {{oozie.launcher.distributed.cache.filter=\*.jar,\*.properties}}. default is {{*}}
* when submit launcher, filter cache files.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)