You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Paritosh Ranjan (JIRA)" <ji...@apache.org> on 2012/06/22 10:09:42 UTC

[jira] [Commented] (MAHOUT-940) Clusterdumper - Get rid of map based implementation

    [ https://issues.apache.org/jira/browse/MAHOUT-940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13399196#comment-13399196 ] 

Paritosh Ranjan commented on MAHOUT-940:
----------------------------------------

Considering nobody has encountered this issue since last few months, and also that now we have ClusterOutputPostProcessor (clusterpp), which can do it for any number of clusters/vectors, I would like to drop this issue.

I propose to mark it Won't Fix until someone feels otherwise. I will wait for a week or so, and then mark it won't fix.
                
> Clusterdumper - Get rid of map based implementation
> ---------------------------------------------------
>
>                 Key: MAHOUT-940
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-940
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Clustering
>    Affects Versions: 0.6
>            Reporter: Paritosh Ranjan
>            Assignee: Paritosh Ranjan
>              Labels: clustering
>             Fix For: Backlog
>
>
> Current implementation of ClusterDumper puts clusters and related vectors in map. This generally results in OOM.
> Since ClusterOutputProcessor is availabale now. The ClusterDumper will at first process the clusteredPoints, and then write down the clusters to a local file. 
> The inability to properly read the clustering output due to ClusterDumper facing OOM is seen too often in the mailing list. This improvement will fix that problem.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira