You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Hudson (Commented) (JIRA)" <ji...@apache.org> on 2011/09/28 02:53:45 UTC

[jira] [Commented] (MAHOUT-818) Canopy Emits Too Many Trivial Clusters

    [ https://issues.apache.org/jira/browse/MAHOUT-818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13116041#comment-13116041 ] 

Hudson commented on MAHOUT-818:
-------------------------------

Integrated in Mahout-Quality #1066 (See [https://builds.apache.org/job/Mahout-Quality/1066/])
    MAHOUT-818: Patch to filter canopies based upon numPoints. All tests run

jeastman : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1176603
Files : 
* /mahout/trunk/core/src/main/java/org/apache/mahout/clustering/canopy/CanopyConfigKeys.java
* /mahout/trunk/core/src/main/java/org/apache/mahout/clustering/canopy/CanopyDriver.java
* /mahout/trunk/core/src/main/java/org/apache/mahout/clustering/canopy/CanopyMapper.java
* /mahout/trunk/core/src/main/java/org/apache/mahout/clustering/canopy/CanopyReducer.java
* /mahout/trunk/core/src/main/java/org/apache/mahout/common/commandline/DefaultOptionCreator.java
* /mahout/trunk/core/src/test/java/org/apache/mahout/clustering/canopy/TestCanopyCreation.java
* /mahout/trunk/examples/src/main/java/org/apache/mahout/clustering/display/DisplayCanopy.java
* /mahout/trunk/examples/src/main/java/org/apache/mahout/clustering/display/DisplayFuzzyKMeans.java

                
> Canopy Emits Too Many Trivial Clusters
> --------------------------------------
>
>                 Key: MAHOUT-818
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-818
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Clustering
>    Affects Versions: 0.5
>            Reporter: Jeff Eastman
>            Assignee: Jeff Eastman
>             Fix For: 0.6
>
>         Attachments: MAHOUT-818.patch
>
>
> Users of Canopy clustering report that the single reducer used in the mapreduce version often takes dispropportately long to process the results of multiple mappers. This patch introduces a new Canopy CLI argument, -cf (--clusterFilter), which if present establishes a lower bound on the numPoints of canopies output from the algorithm. The default value for this filter is 0, and all canopies are output. Setting -cf 1 would eliminate any canopies which contain only 1 point from subsequent processing steps.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira