You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Patcharee Thongtra <Pa...@uni.no> on 2015/03/09 13:28:34 UTC

pig on tez NoSuchMethodError decodeBase64

Hi,

I tried to run pig on TEZ>

pig -Dpig.additional.jars=... -useHCatalog -x TEZ load_u.pig

But I got an exception>

Error cause TezChild exit.:java.lang.NoSuchMethodError: 
org.apache.commons.codec.binary.Base64.decodeBase64(Ljava/lang/String;)[B

It seems the problem is from commons-codec-*.jar, but I am not sure how 
to fix it. Any ideas?

Best,
Patcharee

Re: pig on tez NoSuchMethodError decodeBase64

Posted by Patcharee Thongtra <Pa...@uni.no>.
Hi,

I thought Tez will work with commons-codec 1.4, but I found something 
weird.

There is only commons-codec 1.4 and newer in my cluster, but I got 
error. When I tried to run with explicitly defined commons-codec 1.5,

pig -Dpig.additional.jars=...,commons-codec-1.5.jar -useHCatalog -x TEZ 
load_u.pig

it just worked.

Patcharee


On 03/09/2015 08:42 PM, Daniel Dai wrote:
> Sounds like a commons-codec version conflict. Tez is using commons-codec
> 1.4. Do you see another version of commons-codec.jar in your Hadoop lib or
> CLASSPATH?
>
> Thanks,
> Daniel
>
>
> On 3/9/15, 5:28 AM, "Patcharee Thongtra" <Pa...@uni.no> wrote:
>
>> Hi,
>>
>> I tried to run pig on TEZ>
>>
>> pig -Dpig.additional.jars=... -useHCatalog -x TEZ load_u.pig
>>
>> But I got an exception>
>>
>> Error cause TezChild exit.:java.lang.NoSuchMethodError:
>> org.apache.commons.codec.binary.Base64.decodeBase64(Ljava/lang/String;)[B
>>
>> It seems the problem is from commons-codec-*.jar, but I am not sure how
>> to fix it. Any ideas?
>>
>> Best,
>> Patcharee
>>

Re: pig on tez NoSuchMethodError decodeBase64

Posted by Daniel Dai <da...@hortonworks.com>.
Sounds like a commons-codec version conflict. Tez is using commons-codec
1.4. Do you see another version of commons-codec.jar in your Hadoop lib or
CLASSPATH?

Thanks,
Daniel


On 3/9/15, 5:28 AM, "Patcharee Thongtra" <Pa...@uni.no> wrote:

>Hi,
>
>I tried to run pig on TEZ>
>
>pig -Dpig.additional.jars=... -useHCatalog -x TEZ load_u.pig
>
>But I got an exception>
>
>Error cause TezChild exit.:java.lang.NoSuchMethodError:
>org.apache.commons.codec.binary.Base64.decodeBase64(Ljava/lang/String;)[B
>
>It seems the problem is from commons-codec-*.jar, but I am not sure how
>to fix it. Any ideas?
>
>Best,
>Patcharee
>