You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Sriranjan Manjunath (JIRA)" <ji...@apache.org> on 2009/11/10 09:18:27 UTC
[jira] Created: (PIG-1079) Modify merge join to use distributed
cache to maintain the index
Modify merge join to use distributed cache to maintain the index
----------------------------------------------------------------
Key: PIG-1079
URL: https://issues.apache.org/jira/browse/PIG-1079
Project: Pig
Issue Type: Bug
Reporter: Sriranjan Manjunath
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1079) Modify merge join to use distributed
cache to maintain the index
Posted by "Pradeep Kamath (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Pradeep Kamath updated PIG-1079:
--------------------------------
Fix Version/s: 0.7.0
Assignee: Richard Ding
> Modify merge join to use distributed cache to maintain the index
> ----------------------------------------------------------------
>
> Key: PIG-1079
> URL: https://issues.apache.org/jira/browse/PIG-1079
> Project: Pig
> Issue Type: Bug
> Reporter: Sriranjan Manjunath
> Assignee: Richard Ding
> Fix For: 0.7.0
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1079) Modify merge join to use distributed
cache to maintain the index
Posted by "Pradeep Kamath (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12837408#action_12837408 ]
Pradeep Kamath commented on PIG-1079:
-------------------------------------
+1
> Modify merge join to use distributed cache to maintain the index
> ----------------------------------------------------------------
>
> Key: PIG-1079
> URL: https://issues.apache.org/jira/browse/PIG-1079
> Project: Pig
> Issue Type: Bug
> Reporter: Sriranjan Manjunath
> Assignee: Richard Ding
> Fix For: 0.7.0
>
> Attachments: PIG-1079.patch, PIG-1079.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1079) Modify merge join to use distributed
cache to maintain the index
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1079:
------------------------------
Attachment: PIG-1079.patch
Attached patch uses Hadoop DistributedCache for distribution of merge join index file.
> Modify merge join to use distributed cache to maintain the index
> ----------------------------------------------------------------
>
> Key: PIG-1079
> URL: https://issues.apache.org/jira/browse/PIG-1079
> Project: Pig
> Issue Type: Bug
> Reporter: Sriranjan Manjunath
> Assignee: Richard Ding
> Fix For: 0.7.0
>
> Attachments: PIG-1079.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1079) Modify merge join to use distributed
cache to maintain the index
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1079:
------------------------------
Status: Patch Available (was: Open)
> Modify merge join to use distributed cache to maintain the index
> ----------------------------------------------------------------
>
> Key: PIG-1079
> URL: https://issues.apache.org/jira/browse/PIG-1079
> Project: Pig
> Issue Type: Bug
> Reporter: Sriranjan Manjunath
> Assignee: Richard Ding
> Fix For: 0.7.0
>
> Attachments: PIG-1079.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1079) Modify merge join to use distributed
cache to maintain the index
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1079:
------------------------------
Status: Patch Available (was: Open)
> Modify merge join to use distributed cache to maintain the index
> ----------------------------------------------------------------
>
> Key: PIG-1079
> URL: https://issues.apache.org/jira/browse/PIG-1079
> Project: Pig
> Issue Type: Bug
> Reporter: Sriranjan Manjunath
> Assignee: Richard Ding
> Fix For: 0.7.0
>
> Attachments: PIG-1079.patch, PIG-1079.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1079) Modify merge join to use distributed
cache to maintain the index
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1079:
------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Patch committed (No new unit test is added, just use the existing merge join tests).
> Modify merge join to use distributed cache to maintain the index
> ----------------------------------------------------------------
>
> Key: PIG-1079
> URL: https://issues.apache.org/jira/browse/PIG-1079
> Project: Pig
> Issue Type: Bug
> Reporter: Sriranjan Manjunath
> Assignee: Richard Ding
> Fix For: 0.7.0
>
> Attachments: PIG-1079.patch, PIG-1079.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1079) Modify merge join to use distributed
cache to maintain the index
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12837620#action_12837620 ]
Hadoop QA commented on PIG-1079:
--------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12436736/PIG-1079.patch
against trunk revision 915079.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/213/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/213/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/213/console
This message is automatically generated.
> Modify merge join to use distributed cache to maintain the index
> ----------------------------------------------------------------
>
> Key: PIG-1079
> URL: https://issues.apache.org/jira/browse/PIG-1079
> Project: Pig
> Issue Type: Bug
> Reporter: Sriranjan Manjunath
> Assignee: Richard Ding
> Fix For: 0.7.0
>
> Attachments: PIG-1079.patch, PIG-1079.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Closed: (PIG-1079) Modify merge join to use distributed
cache to maintain the index
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai closed PIG-1079.
---------------------------
> Modify merge join to use distributed cache to maintain the index
> ----------------------------------------------------------------
>
> Key: PIG-1079
> URL: https://issues.apache.org/jira/browse/PIG-1079
> Project: Pig
> Issue Type: Bug
> Reporter: Sriranjan Manjunath
> Assignee: Richard Ding
> Fix For: 0.7.0
>
> Attachments: PIG-1079.patch, PIG-1079.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1079) Modify merge join to use distributed
cache to maintain the index
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1079:
------------------------------
Attachment: PIG-1079.patch
New patch to remove the javadoc warning.
> Modify merge join to use distributed cache to maintain the index
> ----------------------------------------------------------------
>
> Key: PIG-1079
> URL: https://issues.apache.org/jira/browse/PIG-1079
> Project: Pig
> Issue Type: Bug
> Reporter: Sriranjan Manjunath
> Assignee: Richard Ding
> Fix For: 0.7.0
>
> Attachments: PIG-1079.patch, PIG-1079.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1079) Modify merge join to use distributed
cache to maintain the index
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776051#action_12776051 ]
Ashutosh Chauhan commented on PIG-1079:
---------------------------------------
+1 for the direction as it will help reducing the contention for index file. Another option could be to write out the index file with high replication factor.
> Modify merge join to use distributed cache to maintain the index
> ----------------------------------------------------------------
>
> Key: PIG-1079
> URL: https://issues.apache.org/jira/browse/PIG-1079
> Project: Pig
> Issue Type: Bug
> Reporter: Sriranjan Manjunath
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1079) Modify merge join to use distributed
cache to maintain the index
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1079:
------------------------------
Status: Open (was: Patch Available)
> Modify merge join to use distributed cache to maintain the index
> ----------------------------------------------------------------
>
> Key: PIG-1079
> URL: https://issues.apache.org/jira/browse/PIG-1079
> Project: Pig
> Issue Type: Bug
> Reporter: Sriranjan Manjunath
> Assignee: Richard Ding
> Fix For: 0.7.0
>
> Attachments: PIG-1079.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1079) Modify merge join to use distributed
cache to maintain the index
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12837100#action_12837100 ]
Hadoop QA commented on PIG-1079:
--------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12436645/PIG-1079.patch
against trunk revision 915079.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
-1 javadoc. The javadoc tool appears to have generated 1 warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/215/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/215/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/215/console
This message is automatically generated.
> Modify merge join to use distributed cache to maintain the index
> ----------------------------------------------------------------
>
> Key: PIG-1079
> URL: https://issues.apache.org/jira/browse/PIG-1079
> Project: Pig
> Issue Type: Bug
> Reporter: Sriranjan Manjunath
> Assignee: Richard Ding
> Fix For: 0.7.0
>
> Attachments: PIG-1079.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.