[jira] [Commented] (OOZIE-2499) map-reduce launcher does not need distributed files, archives except jar of input/outputformat class

["Hadoop QA (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/OOZIE-2499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15229959#comment-15229959 ] 

Hadoop QA commented on OOZIE-2499:
----------------------------------

Testing JIRA OOZIE-2499

Cleaning local git workspace

----------------------------

{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.    {color:green}+1{color} the patch does not introduce any @author tags
.    {color:red}-1{color} the patch contains 49 line(s) with tabs
.    {color:green}+1{color} the patch does not introduce any trailing spaces
.    {color:green}+1{color} the patch does not introduce any line longer than 132
.    {color:green}+1{color} the patch does adds/modifies 1 testcase(s)
{color:green}+1 RAT{color}
.    {color:green}+1{color} the patch does not seem to introduce new RAT warnings
{color:green}+1 JAVADOC{color}
.    {color:green}+1{color} the patch does not seem to introduce new Javadoc warnings
{color:red}-1 COMPILE{color}
.    {color:green}+1{color} HEAD compiles
.    {color:red}-1{color} patch does not compile
.    {color:green}+1{color} the patch does not seem to introduce new javac warnings
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.    {color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations
.    {color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color} - patch does not compile, cannot run testcases
{color:red}-1 DISTRO{color}
.    {color:red}-1{color} distro tarball fails with the patch

----------------------------
{color:red}*-1 Overall result, please check the reported -1(s)*{color}


The full output of the test-patch run is available at

.   https://builds.apache.org/job/oozie-trunk-precommit-build/2816/

> map-reduce launcher does not need distributed files, archives except  jar of input/outputformat class
> -----------------------------------------------------------------------------------------------------
>
>                 Key: OOZIE-2499
>                 URL: https://issues.apache.org/jira/browse/OOZIE-2499
>             Project: Oozie
>          Issue Type: Improvement
>          Components: core
>    Affects Versions: 4.2.0
>            Reporter: KWON BYUNGCHANG
>            Priority: Minor
>             Fix For: 4.2.0
>
>         Attachments: OOZIE-2499.001.patch
>
>
> In map-reduce action, when specify {{file}}, {{archives}} element,  {{JavaActionExccutor}} add it to distributed cache for configuration of launcher. 
> It cause slow launching mr job.
> In fact, all most launcher does not need  {{file}} , {{archives}}.  launcher need to  inputformat/outputformat class and its dependency.
> I make a proposal below feature.
> * add property {{oozie.launcher.distributed.cache.filter=\*.jar,\*.properties}}. default is {{*}}
> * when configure launcher, filter cache files. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)