You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Saikat Kanjilal (Commented) (JIRA)" <ji...@apache.org> on 2012/03/31 16:28:25 UTC
[jira] [Commented] (MAHOUT-940) Clusterdumper - Get rid of map
based implementation
[ https://issues.apache.org/jira/browse/MAHOUT-940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13243165#comment-13243165 ]
Saikat Kanjilal commented on MAHOUT-940:
----------------------------------------
Paritosh,
I'm assuming OOM means out of memory, is that correct? So to be clear is the solution to this to use the ClusteredOutputProcessor instead of the ClusterDumper? I will research code and move forward with an implementation. Will ask questions if I get stuck,
> Clusterdumper - Get rid of map based implementation
> ---------------------------------------------------
>
> Key: MAHOUT-940
> URL: https://issues.apache.org/jira/browse/MAHOUT-940
> Project: Mahout
> Issue Type: Improvement
> Components: Clustering
> Affects Versions: 0.6
> Reporter: Paritosh Ranjan
> Assignee: Paritosh Ranjan
> Fix For: 0.7
>
>
> Current implementation of ClusterDumper puts clusters and related vectors in map. This generally results in OOM.
> Since ClusterOutputProcessor is availabale now. The ClusterDumper will at first process the clusteredPoints, and then write down the clusters to a local file.
> The inability to properly read the clustering output due to ClusterDumper facing OOM is seen too often in the mailing list. This improvement will fix that problem.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira