You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Edward J. Yoon (JIRA)" <ji...@apache.org> on 2009/02/24 04:08:03 UTC
[jira] Created: (HAMA-158) Implementation of random sparse matrix
using mapreduce
Implementation of random sparse matrix using mapreduce
------------------------------------------------------
Key: HAMA-158
URL: https://issues.apache.org/jira/browse/HAMA-158
Project: Hama
Issue Type: Sub-task
Reporter: Edward J. Yoon
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HAMA-158) Implementation of random sparse matrix
using mapreduce
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon updated HAMA-158:
--------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I've just committed this.
> Implementation of random sparse matrix using mapreduce
> ------------------------------------------------------
>
> Key: HAMA-158
> URL: https://issues.apache.org/jira/browse/HAMA-158
> Project: Hama
> Issue Type: Sub-task
> Affects Versions: 0.1.0
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.1.0
>
> Attachments: HAMA-158.patch, HAMA-158_v01.patch, HAMA-158_v02.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HAMA-158) Implementation of random sparse matrix
using mapreduce
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon updated HAMA-158:
--------------------------------
Fix Version/s: 0.1.0
Affects Version/s: 0.1.0
Status: Patch Available (was: In Progress)
Running patch through Hudson
> Implementation of random sparse matrix using mapreduce
> ------------------------------------------------------
>
> Key: HAMA-158
> URL: https://issues.apache.org/jira/browse/HAMA-158
> Project: Hama
> Issue Type: Sub-task
> Affects Versions: 0.1.0
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.1.0
>
> Attachments: HAMA-158.patch, HAMA-158_v01.patch, HAMA-158_v02.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HAMA-158) Implementation of random sparse matrix
using mapreduce
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon reassigned HAMA-158:
-----------------------------------
Assignee: Edward J. Yoon
> Implementation of random sparse matrix using mapreduce
> ------------------------------------------------------
>
> Key: HAMA-158
> URL: https://issues.apache.org/jira/browse/HAMA-158
> Project: Hama
> Issue Type: Sub-task
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Attachments: HAMA-158.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HAMA-158) Implementation of random sparse matrix
using mapreduce
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon updated HAMA-158:
--------------------------------
Attachment: HAMA-158.patch
Here's my test patch.
> Implementation of random sparse matrix using mapreduce
> ------------------------------------------------------
>
> Key: HAMA-158
> URL: https://issues.apache.org/jira/browse/HAMA-158
> Project: Hama
> Issue Type: Sub-task
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Attachments: HAMA-158.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HAMA-158) Implementation of random sparse matrix
using mapreduce
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12680381#action_12680381 ]
Edward J. Yoon commented on HAMA-158:
-------------------------------------
The one zero matrix also need.
> Implementation of random sparse matrix using mapreduce
> ------------------------------------------------------
>
> Key: HAMA-158
> URL: https://issues.apache.org/jira/browse/HAMA-158
> Project: Hama
> Issue Type: Sub-task
> Reporter: Edward J. Yoon
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HAMA-158) Implementation of random sparse matrix
using mapreduce
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon updated HAMA-158:
--------------------------------
Attachment: HAMA-158_v01.patch
attach my patch.
> Implementation of random sparse matrix using mapreduce
> ------------------------------------------------------
>
> Key: HAMA-158
> URL: https://issues.apache.org/jira/browse/HAMA-158
> Project: Hama
> Issue Type: Sub-task
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Attachments: HAMA-158.patch, HAMA-158_v01.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HAMA-158) Implementation of random sparse matrix
using mapreduce
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12700671#action_12700671 ]
Hudson commented on HAMA-158:
-----------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12405899/HAMA-158_v02.patch
against trunk revision 762235.
@author +1. The patch does not contain any @author tags.
tests included +1. The patch appears to include 6 new or modified tests.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit +1. The applied patch does not generate any new release audit warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hama-Patch/169/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hama-Patch/169/artifact/trunk/build/reports/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hama-Patch/169/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hama-Patch/169/console
This message is automatically generated.
> Implementation of random sparse matrix using mapreduce
> ------------------------------------------------------
>
> Key: HAMA-158
> URL: https://issues.apache.org/jira/browse/HAMA-158
> Project: Hama
> Issue Type: Sub-task
> Affects Versions: 0.1.0
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.1.0
>
> Attachments: HAMA-158.patch, HAMA-158_v01.patch, HAMA-158_v02.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HAMA-158) Implementation of random sparse matrix
using mapreduce
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon updated HAMA-158:
--------------------------------
Attachment: HAMA-158_v02.patch
To avoid the timeout error, the iterative method was used for mat-mat mult as a each row of matrix A * matrix B.
> Implementation of random sparse matrix using mapreduce
> ------------------------------------------------------
>
> Key: HAMA-158
> URL: https://issues.apache.org/jira/browse/HAMA-158
> Project: Hama
> Issue Type: Sub-task
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Attachments: HAMA-158.patch, HAMA-158_v01.patch, HAMA-158_v02.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HAMA-158) Implementation of random sparse matrix
using mapreduce
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12682240#action_12682240 ]
Edward J. Yoon commented on HAMA-158:
-------------------------------------
Current algorithm seems too heavy to each mapper.
[d8g053:/root/hama-trunk]# bin/hama examples mult fiveA fiveB
09/03/16 16:34:25 INFO hama.AbstractMatrix: Initializing the matrix storage.
09/03/16 16:34:29 INFO hama.AbstractMatrix: Create Matrix SparseMatrix_randijiat
09/03/16 16:34:29 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
09/03/16 16:34:29 WARN mapred.JobClient: Use genericOptions for the option -libjars
09/03/16 16:34:30 WARN mapred.JobClient: No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
09/03/16 16:34:30 INFO mapred.HTableInputFormatBase: split: 0->d8g054.nhncorp.com:,000000000001692
09/03/16 16:34:30 INFO mapred.HTableInputFormatBase: split: 1->d8g055.nhncorp.com:000000000001692,000000000003678
09/03/16 16:34:30 INFO mapred.HTableInputFormatBase: split: 2->d8g055.nhncorp.com:000000000003678,
09/03/16 16:34:30 INFO mapred.JobClient: Running job: job_200902131649_0050
09/03/16 16:34:31 INFO mapred.JobClient: map 0% reduce 0%
09/03/16 16:45:05 INFO mapred.JobClient: Task Id : attempt_200902131649_0050_m_000002_0, Status : FAILED
Task attempt_200902131649_0050_m_000002_0 failed to report status for 600 seconds. Killing!
> Implementation of random sparse matrix using mapreduce
> ------------------------------------------------------
>
> Key: HAMA-158
> URL: https://issues.apache.org/jira/browse/HAMA-158
> Project: Hama
> Issue Type: Sub-task
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Attachments: HAMA-158.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HAMA-158) Implementation of random sparse matrix
using mapreduce
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12695948#action_12695948 ]
Edward J. Yoon commented on HAMA-158:
-------------------------------------
The each map spend too long time. Iterative method is one way to fix this problem.
> Implementation of random sparse matrix using mapreduce
> ------------------------------------------------------
>
> Key: HAMA-158
> URL: https://issues.apache.org/jira/browse/HAMA-158
> Project: Hama
> Issue Type: Sub-task
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Attachments: HAMA-158.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.