You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Dmitriy V. Ryaboy (JIRA)" <ji...@apache.org> on 2011/04/22 03:33:05 UTC
[jira] [Updated] (PIG-2010) Bundle registered jars via distributed
cache
[ https://issues.apache.org/jira/browse/PIG-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dmitriy V. Ryaboy updated PIG-2010:
-----------------------------------
Attachment: pig-2010.patch
This patch by Travis Crawford implements the change.
Note that as written, the patch depends on Hadoop's MAPRECUDE-787 which is available in CDH3 and Hadoop 0.21.
Looks like 787 was also rolled into the yahoo distribution, so it may be available in the security branch?
> Bundle registered jars via distributed cache
> --------------------------------------------
>
> Key: PIG-2010
> URL: https://issues.apache.org/jira/browse/PIG-2010
> Project: Pig
> Issue Type: Improvement
> Reporter: Dmitriy V. Ryaboy
> Attachments: pig-2010.patch
>
>
> Currently registered jars get collapsed into a single job megajar that gets submitted to Hadoop.
> A better pattern would be to take advantage of the distributed cache.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira