You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Zhuang Kechen (JIRA)" <ji...@apache.org> on 2012/09/13 12:38:07 UTC
[jira] [Created] (HAMA-640) Large graph computing cause out of
memory
Zhuang Kechen created HAMA-640:
----------------------------------
Summary: Large graph computing cause out of memory
Key: HAMA-640
URL: https://issues.apache.org/jira/browse/HAMA-640
Project: Hama
Issue Type: Question
Components: graph
Affects Versions: 0.5.0
Environment: hadoop-1.0.3 hama-0.5.0
Reporter: Zhuang Kechen
When I test some small graphs PageRank on distributed environment, everything went all right. When I upload a Larger graph(758Mb) on HDFS, the graph format is all the same, and the PageRank went right on SuperStep 0,1,2, then job failed after that, out of memory. I didn't change the examples, the test use the hama-examples pagerank.
Somebody please help...Thanks!!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-640) Large graph computing cause out of
memory
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454797#comment-13454797 ]
Edward J. Yoon commented on HAMA-640:
-------------------------------------
Hi, I would recommend you to use TRUNK version.
> Large graph computing cause out of memory
> -----------------------------------------
>
> Key: HAMA-640
> URL: https://issues.apache.org/jira/browse/HAMA-640
> Project: Hama
> Issue Type: Question
> Components: graph
> Affects Versions: 0.5.0
> Environment: hadoop-1.0.3 hama-0.5.0
> Reporter: Zhuang Kechen
>
> When I test some small graphs PageRank on distributed environment, everything went all right. When I upload a Larger graph(758Mb) on HDFS, the graph format is all the same, and the PageRank went right on SuperStep 0,1,2, then job failed after that, out of memory. I didn't change the examples, the test use the hama-examples pagerank.
> Somebody please help...Thanks!!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-640) Large graph computing cause out of
memory
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454841#comment-13454841 ]
Thomas Jungblut commented on HAMA-640:
--------------------------------------
Hi Zhuang, this JIRA is just for development tracking. I would advise you to come to our user mailing list and explain yourself.
We are aware of the memory hunger and improved in HAMA-596 which will be release with 0.6.0.
At least you have multiple options:
- increase the heap of each task in your job by lifting the -Xmx configuration property in "bsp.child.java.opts".
- use the trunk version (build for yourself)
- wait for the next release
I will close this, thanks for your report.
> Large graph computing cause out of memory
> -----------------------------------------
>
> Key: HAMA-640
> URL: https://issues.apache.org/jira/browse/HAMA-640
> Project: Hama
> Issue Type: Question
> Components: graph
> Affects Versions: 0.5.0
> Environment: hadoop-1.0.3 hama-0.5.0
> Reporter: Zhuang Kechen
>
> When I test some small graphs PageRank on distributed environment, everything went all right. When I upload a Larger graph(758Mb) on HDFS, the graph format is all the same, and the PageRank went right on SuperStep 0,1,2, then job failed after that, out of memory. I didn't change the examples, the test use the hama-examples pagerank.
> Somebody please help...Thanks!!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HAMA-640) Large graph computing cause out of
memory
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut resolved HAMA-640.
----------------------------------
Resolution: Won't Fix
> Large graph computing cause out of memory
> -----------------------------------------
>
> Key: HAMA-640
> URL: https://issues.apache.org/jira/browse/HAMA-640
> Project: Hama
> Issue Type: Question
> Components: graph
> Affects Versions: 0.5.0
> Environment: hadoop-1.0.3 hama-0.5.0
> Reporter: Zhuang Kechen
>
> When I test some small graphs PageRank on distributed environment, everything went all right. When I upload a Larger graph(758Mb) on HDFS, the graph format is all the same, and the PageRank went right on SuperStep 0,1,2, then job failed after that, out of memory. I didn't change the examples, the test use the hama-examples pagerank.
> Somebody please help...Thanks!!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira