[jira] [Updated] (PIG-3930) "java.io.IOException: Cannot initialize Cluster" in local mode with hadoopversion=23 dependencies

["Cheolsoo Park (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/PIG-3930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Cheolsoo Park updated PIG-3930:
-------------------------------

       Resolution: Fixed
    Fix Version/s: 0.13.0
           Status: Resolved  (was: Patch Available)

Committed to trunk. Thank you Gera!

> "java.io.IOException: Cannot initialize Cluster" in local mode with hadoopversion=23 dependencies
> -------------------------------------------------------------------------------------------------
>
>                 Key: PIG-3930
>                 URL: https://issues.apache.org/jira/browse/PIG-3930
>             Project: Pig
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.12.0
>            Reporter: Gera Shegalov
>            Assignee: Gera Shegalov
>            Priority: Critical
>             Fix For: 0.13.0
>
>         Attachments: PIG-3930.v01.patch
>
>
> Steps to reproduce with script wc.pig
> {code}
> A = load 'README.txt';
> B = foreach A generate flatten(TOKENIZE((chararray)$0)) as word;
> C = group B by word;
> D = foreach C generate COUNT(B), group;
> store D into 'wc.out';
> {code}
> # $ cd workspace/pig-trunk
> # $ ant clean -Dhadoopversion=23 jar
> # $ bin/pig -x local  ~/wc.pig 
> The problem is that in the dependency {{./build/ivy/lib/Pig/hadoop-mapreduce-client-common-2.0.3-alpha.jar}} the file {{META-INF/services/org.apache.hadoop.mapreduce.protocol.ClientProtocolProvider}} lacks the entry {{org.apache.hadoop.mapred.LocalClientProtocolProvider}}.
> When the dependency is folded into fat pig.jar {{src/META-INF/services/org.apache.hadoop.mapreduce.protocol.ClientProtocolProvider}} is overwritten. 
> This can be fixed by using duplicate="preserve" in ant jar task.



--
This message was sent by Atlassian JIRA
(v6.2#6252)