You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Edward J. Yoon (JIRA)" <ji...@apache.org> on 2009/04/09 06:46:13 UTC
[jira] Created: (HAMA-175) Multiple job handling
Multiple job handling
---------------------
Key: HAMA-175
URL: https://issues.apache.org/jira/browse/HAMA-175
Project: Hama
Issue Type: Improvement
Components: implementation
Affects Versions: 0.1.0
Reporter: Edward J. Yoon
Assignee: Edward J. Yoon
Fix For: 0.1.0
It would be nice if collectBlocksMapRed jobs are run at the same time.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HAMA-175) Multiple job handling
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon updated HAMA-175:
--------------------------------
Status: Patch Available (was: Open)
Local test passed.
Sequential Collecting : 20 minutes
Parallel Collecting : 13 minutes
Running patch through Hudson.
> Multiple job handling
> ---------------------
>
> Key: HAMA-175
> URL: https://issues.apache.org/jira/browse/HAMA-175
> Project: Hama
> Issue Type: Improvement
> Components: implementation
> Affects Versions: 0.1.0
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.1.0
>
> Attachments: HAMA-175.patch, HAMA-175_v01.patch
>
>
> It would be nice if collectBlocksMapRed jobs are run at the same time.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HAMA-175) Multiple job handling
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon updated HAMA-175:
--------------------------------
Attachment: HAMA-175.patch
Attach my patch.
> Multiple job handling
> ---------------------
>
> Key: HAMA-175
> URL: https://issues.apache.org/jira/browse/HAMA-175
> Project: Hama
> Issue Type: Improvement
> Components: implementation
> Affects Versions: 0.1.0
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.1.0
>
> Attachments: HAMA-175.patch
>
>
> It would be nice if collectBlocksMapRed jobs are run at the same time.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HAMA-175) Multiple job handling
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697405#action_12697405 ]
Hudson commented on HAMA-175:
-----------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12405039/HAMA-175_v01.patch
against trunk revision 762235.
@author +1. The patch does not contain any @author tags.
tests included -1. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit +1. The applied patch does not generate any new release audit warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hama-Patch/167/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hama-Patch/167/artifact/trunk/build/reports/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hama-Patch/167/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hama-Patch/167/console
This message is automatically generated.
> Multiple job handling
> ---------------------
>
> Key: HAMA-175
> URL: https://issues.apache.org/jira/browse/HAMA-175
> Project: Hama
> Issue Type: Improvement
> Components: implementation
> Affects Versions: 0.1.0
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.1.0
>
> Attachments: HAMA-175.patch, HAMA-175_v01.patch
>
>
> It would be nice if collectBlocksMapRed jobs are run at the same time.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HAMA-175) Multiple job handling
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon updated HAMA-175:
--------------------------------
Resolution: Won't Fix
Status: Resolved (was: Patch Available)
Hmm, I don't see any improve/benefit of performance.
Won't fix.
> Multiple job handling
> ---------------------
>
> Key: HAMA-175
> URL: https://issues.apache.org/jira/browse/HAMA-175
> Project: Hama
> Issue Type: Improvement
> Components: implementation
> Affects Versions: 0.1.0
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.1.0
>
> Attachments: HAMA-175.patch, HAMA-175_v01.patch
>
>
> It would be nice if collectBlocksMapRed jobs are run at the same time.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HAMA-175) Multiple job handling
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon updated HAMA-175:
--------------------------------
Attachment: HAMA-175_v01.patch
Fix javadoc warnings.
> Multiple job handling
> ---------------------
>
> Key: HAMA-175
> URL: https://issues.apache.org/jira/browse/HAMA-175
> Project: Hama
> Issue Type: Improvement
> Components: implementation
> Affects Versions: 0.1.0
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.1.0
>
> Attachments: HAMA-175.patch, HAMA-175_v01.patch
>
>
> It would be nice if collectBlocksMapRed jobs are run at the same time.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HAMA-175) Multiple job handling
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697409#action_12697409 ]
Edward J. Yoon commented on HAMA-175:
-------------------------------------
Hmm, After patch applying, I only see the collectionTable that stored on a single node.
It seems requires some time for distributing.
----
09/04/09 15:45:59 INFO mapred.JobClient: Map output records=100000
09/04/09 15:45:59 INFO mapred.JobClient: Reduce input records=100000
09/04/09 15:45:59 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
09/04/09 15:45:59 WARN mapred.JobClient: Use genericOptions for the option -libjars
09/04/09 15:45:59 WARN mapred.JobClient: No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
09/04/09 15:45:59 INFO mapred.HTableInputFormatBase: split: 0->d8g053.nhncorp.com:,00000000000,17,17-7156
09/04/09 15:45:59 INFO mapred.HTableInputFormatBase: split: 1->d8g053.nhncorp.com:00000000000,17,17-7156,000000000000,14,5-5707
09/04/09 15:45:59 INFO mapred.HTableInputFormatBase: split: 2->d8g053.nhncorp.com:000000000000,14,5-5707,000000000000,5,13-2260
09/04/09 15:45:59 INFO mapred.HTableInputFormatBase: split: 3->d8g053.nhncorp.com:000000000000,5,13-2260,0000000000000,1,1-423
09/04/09 15:45:59 INFO mapred.HTableInputFormatBase: split: 4->d8g053.nhncorp.com:0000000000000,1,1-423,
09/04/09 15:45:59 INFO mapred.JobClient: Running job: job_200904081716_0025
> Multiple job handling
> ---------------------
>
> Key: HAMA-175
> URL: https://issues.apache.org/jira/browse/HAMA-175
> Project: Hama
> Issue Type: Improvement
> Components: implementation
> Affects Versions: 0.1.0
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.1.0
>
> Attachments: HAMA-175.patch, HAMA-175_v01.patch
>
>
> It would be nice if collectBlocksMapRed jobs are run at the same time.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.