You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Costin Leau (JIRA)" <ji...@apache.org> on 2015/06/07 22:01:00 UTC

[jira] [Created] (PIG-4592) Pig 0.15 stopped working with Hadoop 1.x

Costin Leau created PIG-4592:
--------------------------------

             Summary: Pig 0.15 stopped working with Hadoop 1.x
                 Key: PIG-4592
                 URL: https://issues.apache.org/jira/browse/PIG-4592
             Project: Pig
          Issue Type: Bug
          Components: build
    Affects Versions: 0.15.0
         Environment: Hadoop 1.x and pig.jar retrieved from Maven
            Reporter: Costin Leau
            Priority: Blocker


It looks like the Maven jar for Pig 0.15 is built against Hadoop 1.x instead of Hadoop 2.x.
Running Pig 0.15 against a Hadoop 1 environment (which works fine in 0.14) triggers a storm of class not found exceptions for classes in Hadoop 2 (like org/apache/hadoop/mapreduce/task/JobContextImpl).

The culprit seems to be the HadoopShim included in 0.15 which is different from 0.14 (and previous) - it's part of hadoop23 instead of hadoop20 package (whatever that means).

As it stands right now, using Pig 0.15 from Maven (common case) with Hadoop 1.x is impossible.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)