You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2015/06/16 23:31:02 UTC
[jira] [Comment Edited] (PIG-4592) Pig 0.15 stopped working with
Hadoop 1.x
[ https://issues.apache.org/jira/browse/PIG-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588812#comment-14588812 ]
Rohini Palaniswamy edited comment on PIG-4592 at 6/16/15 9:30 PM:
------------------------------------------------------------------
Shouldn't
{code}tofile="${output.jarfile.core}"{code} be {code}tofile="${output.jarfile.core-h1}" {code}?
was (Author: rohini):
Shouldn't tofile="${output.jarfile.core}" be tofile="${output.jarfile.core-h1}" ?
> Pig 0.15 stopped working with Hadoop 1.x
> ----------------------------------------
>
> Key: PIG-4592
> URL: https://issues.apache.org/jira/browse/PIG-4592
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.15.0
> Environment: Hadoop 1.x and pig.jar retrieved from Maven
> Reporter: Costin Leau
> Assignee: Daniel Dai
> Priority: Blocker
> Fix For: 0.15.0
>
> Attachments: PIG-4592-1.patch
>
>
> It looks like the Maven jar for Pig 0.15 is built against Hadoop 1.x instead of Hadoop 2.x.
> Running Pig 0.15 against a Hadoop 1 environment (which works fine in 0.14) triggers a storm of class not found exceptions for classes in Hadoop 2 (like org/apache/hadoop/mapreduce/task/JobContextImpl).
> The culprit seems to be the HadoopShim included in 0.15 which is different from 0.14 (and previous) - it's part of hadoop23 instead of hadoop20 package (whatever that means).
> As it stands right now, using Pig 0.15 from Maven (common case) with Hadoop 1.x is impossible.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)