You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Giridharan Kesavan (JIRA)" <ji...@apache.org> on 2010/06/16 10:44:23 UTC
[jira] Created: (PIG-1452) to remove hadoop20.jar from lib and use
hadoop from the apache maven repo.
to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
--------------------------------------------------------------------------
Key: PIG-1452
URL: https://issues.apache.org/jira/browse/PIG-1452
Project: Pig
Issue Type: Improvement
Components: build
Affects Versions: 0.8.0
Reporter: Giridharan Kesavan
pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1452) to remove hadoop20.jar from lib and use
hadoop from the apache maven repo.
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1452:
------------------------------
Attachment: PIG-1452_3.patch
I resynced the patch with the trunk and the size of pig.jar now is about 8M.
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452_3.patch, PIG-1452V2.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1452) to remove hadoop20.jar from lib and use
hadoop from the apache maven repo.
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Giridharan Kesavan updated PIG-1452:
------------------------------------
Attachment: PIG-1452V2.PATCH
Attached patch would add hadoop and transient dependencies to the pig.jar file as well resolve hadoop from maven repo.
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452V2.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Konstantin Boudnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12879440#action_12879440 ]
Konstantin Boudnik commented on PIG-1452:
-----------------------------------------
I am wondering if these dependencies
{noformat}
+ <dependency org="log4j" name="log4j" rev="${log4j.version}"
+ conf="compile->master"/>
...
+ <dependency org="org.mortbay.jetty" name="jetty-util" rev="${jetty-util.version}"
+ conf="compile->master"/>
{noformat}
won't be automatically retrieved via Hadoop's POM as it requires them anyway?
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: PIG-1452.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12894721#action_12894721 ]
Daniel Dai commented on PIG-1452:
---------------------------------
Hi, Giri,
I think approach 2 may be simpler. We only need to exclude three jars which are pulled by Pig:
hsqldb.jar
jython.jar
javacc.jar
Besides that, I see some more jars pulled along with hadoop, eg: core-3.1.1.jar, ftpserver-deprecated-1.0.0-M2.jar, etc, which we never see before and it drastically increase the size of pig.jar. Do you know what's happen? How can we exclude these jars?
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452V2.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12894106#action_12894106 ]
Daniel Dai commented on PIG-1452:
---------------------------------
We shall retain the old pig.jar. There are two way to achieve it:
1. List all jars we needed for pig.jar. We need to track all hadoop dependent jars, I am not sure if it is realistic.
2. Pack all jars in ivy lib, but exclude files Pig brings but we don't want in pig.jar. By doing this we will not miss any hadoop dependent jars. I can give you a list of excluded jars if we decide to take this route.
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452V2.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12894651#action_12894651 ]
Giridharan Kesavan commented on PIG-1452:
-----------------------------------------
we can just include the list of jars that you may want it as part of the pig jar.
Only reason I didnt do it in first place is that I didnt want to write 15 to 20 lines of zipfileset. Looks like its necessary for the given scenario.
As long as someone can give me the list of jars that should go into the pig.jar, I shall add it to the pig.jar
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452V2.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12893942#action_12893942 ]
Daniel Dai commented on PIG-1452:
---------------------------------
Now we pack everything in ivy lib, the size of pig.jar increase from 11M to 26M. It is better not to change the content of pig.jar, only change the way we generate it after patch. Can bring back the old pig.jar content? (only pack hadoop and its dependent classes, and the libraries listed in build.xml)
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452V2.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12886971#action_12886971 ]
Olga Natkovich commented on PIG-1452:
-------------------------------------
Giri, can you commit this?
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: PIG-1452.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (PIG-1452) to remove hadoop20.jar from lib and use
hadoop from the apache maven repo.
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Giridharan Kesavan reassigned PIG-1452:
---------------------------------------
Assignee: Giridharan Kesavan
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: PIG-1452.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899631#action_12899631 ]
Richard Ding commented on PIG-1452:
-----------------------------------
The target "buildJar-withouthadoop" doesn't depend on hadoop20.jar so this change doesn't affect this target.
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452_3.patch, PIG-1452V2.PATCH, PIG-1452V4.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899639#action_12899639 ]
Daniel Dai commented on PIG-1452:
---------------------------------
Richard is right. +1 for the patch once test pass.
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452_3.patch, PIG-1452V2.PATCH, PIG-1452V4.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12893793#action_12893793 ]
Hadoop QA commented on PIG-1452:
--------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12450812/PIG-1452V2.PATCH
against trunk revision 980276.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
-1 javadoc. The javadoc tool appears to have generated 1 warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/365/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/365/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/365/console
This message is automatically generated.
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452V2.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1452) to remove hadoop20.jar from lib and use
hadoop from the apache maven repo.
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Giridharan Kesavan updated PIG-1452:
------------------------------------
Attachment: PIG-1452.PATCH
this patch deletes the hadoop20.jar from the lib folder and resolves/retrieves hadoop from maven repository using ivy.
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Attachments: PIG-1452.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Konstantin Boudnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12894077#action_12894077 ]
Konstantin Boudnik commented on PIG-1452:
-----------------------------------------
Normally, it isn't a good idea at all to include any jars into a production jar file. If you need extra jars to be delivered they are better be delivered separately, i.e. through Ivy dependencies. So, I believe the build needs to be changed a bit especially in this line
{noformat}
+ <zipgroupfileset dir="${ivy.lib.dir}" includes="*.jar" />
{noformat}
While I am not suggesting how Pig needs to deliver its stuff having dependency jars packed into the same gigantic jar file doesn't seem right.
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452V2.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Reopened: (PIG-1452) to remove hadoop20.jar from lib and use
hadoop from the apache maven repo.
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai reopened PIG-1452:
-----------------------------
Hi, Giri,
With this change, pig.jar only bundle core hadoop classes. We may not want to change pig.jar. We still want pig.jar contain all dependencies so we can run it directly. Can you fix it?
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1452) to remove hadoop20.jar from lib and use
hadoop from the apache maven repo.
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1452:
------------------------------
Status: Open (was: Patch Available)
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452_3.patch, PIG-1452V2.PATCH, PIG-1452V4.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12895045#action_12895045 ]
Daniel Dai commented on PIG-1452:
---------------------------------
hsqldb.jar is pulled by Pig only for unit test. I am not sure if hadoop also depend on it or not, if that's the case, then we should retain it. For those transient dependencies, can we exclude them from pig.jar? Some jars such as core-3.1.1.jar is really big. Since pig.jar will be shipped to every backend node, we really want to keep it smaller.
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452V2.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12894809#action_12894809 ]
Giridharan Kesavan commented on PIG-1452:
-----------------------------------------
bq. We only need to exclude three jars which are pulled by Pig:
hsqldb.jar
jython.jar
javacc.jar
I remember that hadoop depends on hsqldb.jar.
Is there any reason why we dont want it to be added to the pig.jar?
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452V2.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12887948#action_12887948 ]
Daniel Dai commented on PIG-1452:
---------------------------------
I temporarily rollback PIG-1452 since all builds will fail (piggybank, zebra, nightly).
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1452) to remove hadoop20.jar from lib and use
hadoop from the apache maven repo.
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1452:
------------------------------
Status: Resolved (was: Patch Available)
Resolution: Fixed
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452_3.patch, PIG-1452V2.PATCH, PIG-1452V4.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1452) to remove hadoop20.jar from lib and use
hadoop from the apache maven repo.
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Giridharan Kesavan updated PIG-1452:
------------------------------------
Status: Patch Available (was: Reopened)
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452V2.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Konstantin Boudnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12879600#action_12879600 ]
Konstantin Boudnik commented on PIG-1452:
-----------------------------------------
bq. But I added these dependencies b'coz pig directly depends on these
Makes sense. Thanks.
+1 patch looks good (although I'm not a Pig committer)
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: PIG-1452.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12894807#action_12894807 ]
Giridharan Kesavan commented on PIG-1452:
-----------------------------------------
bq. Besides that, I see some more jars pulled along with hadoop, eg: core-3.1.1.jar, ftpserver-deprecated-1.0.0-M2.jar, etc, which we never see before and it drastically increase the size of pig.jar. Do you know what's happen? How can we exclude these jars?
These are transient dependencies of hadoop-test.jar
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452V2.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1452) to remove hadoop20.jar from lib and use
hadoop from the apache maven repo.
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Giridharan Kesavan updated PIG-1452:
------------------------------------
Status: Patch Available (was: Open)
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: PIG-1452.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1452) to remove hadoop20.jar from lib and use
hadoop from the apache maven repo.
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olga Natkovich updated PIG-1452:
--------------------------------
Fix Version/s: 0.8.0
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1452) to remove hadoop20.jar from lib and use
hadoop from the apache maven repo.
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1452:
------------------------------
Attachment: PIG-1452V4.PATCH
New patch fixing the contrib projects.
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452_3.patch, PIG-1452V2.PATCH, PIG-1452V4.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12879478#action_12879478 ]
Giridharan Kesavan commented on PIG-1452:
-----------------------------------------
Yes actually hadoop would resolve/retrieve its transient dependencies. But I added these dependencies b'coz pig directly depends on these.
When we remove these new set of dependencies pig build would fail even before failing for not having hadoop.
(Here ivy is smart enough so it woudnt retrieve these artifacts, though they are transient dependencies of hadoop again)
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: PIG-1452.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12879512#action_12879512 ]
Olga Natkovich commented on PIG-1452:
-------------------------------------
I tested the patch and it works fine. I think Pig's direct dependencies should be included since in general we can't know what packages we get indirectly.
I am ready to commit this unless I hear otherwise.
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: PIG-1452.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12893959#action_12893959 ]
Daniel Dai commented on PIG-1452:
---------------------------------
Or we can include an exclusion list. We will exclude some known jars (such as jython.jar, etc) in pig.jar.
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452V2.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899560#action_12899560 ]
Daniel Dai commented on PIG-1452:
---------------------------------
Shall we do the same thing to the target "buildJar-withouthadoop"?
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452_3.patch, PIG-1452V2.PATCH, PIG-1452V4.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1452) to remove hadoop20.jar from lib and use
hadoop from the apache maven repo.
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Giridharan Kesavan updated PIG-1452:
------------------------------------
Status: Resolved (was: Patch Available)
Hadoop Flags: [Reviewed]
Resolution: Fixed
I just committed this!
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12879414#action_12879414 ]
Hadoop QA commented on PIG-1452:
--------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12447216/PIG-1452.PATCH
against trunk revision 955028.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/339/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/339/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/339/console
This message is automatically generated.
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: PIG-1452.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Jeff Bowles (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12887943#action_12887943 ]
Jeff Bowles commented on PIG-1452:
----------------------------------
You should be able to get those needed files from the maven/ivy repository. That hadoop-all sort of jar creates all sorts of maintenance heads, starting with the basics of keeping your static-copy up-to-date and continuing from there.
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1452) to remove hadoop20.jar from lib and use
hadoop from the apache maven repo.
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1452:
------------------------------
Status: Patch Available (was: Open)
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH, PIG-1452_3.patch, PIG-1452V2.PATCH, PIG-1452V4.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and
use hadoop from the apache maven repo.
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12887944#action_12887944 ]
Olga Natkovich commented on PIG-1452:
-------------------------------------
That's fine. We already providing users and unbundled version; however, for convinience we also provided an bundled one and this patch broke this comptaibility
> to remove hadoop20.jar from lib and use hadoop from the apache maven repo.
> --------------------------------------------------------------------------
>
> Key: PIG-1452
> URL: https://issues.apache.org/jira/browse/PIG-1452
> Project: Pig
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.8.0
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.8.0
>
> Attachments: PIG-1452.PATCH
>
>
> pig use ivy for dependency management. But still it uses hadoop20.jar from the lib folder.
> Now that we have the hadoop-0.20.2 artifacts available in the maven repo, pig should leverage ivy for resolving/retrieving hadoop artifacts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.