You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Grant Ingersoll (Created) (JIRA)" <ji...@apache.org> on 2011/11/27 23:00:40 UTC

[jira] [Created] (MAHOUT-899) Add Point Sampling to ClusterDumper

Add Point Sampling to ClusterDumper
-----------------------------------

                 Key: MAHOUT-899
                 URL: https://issues.apache.org/jira/browse/MAHOUT-899
             Project: Mahout
          Issue Type: Improvement
          Components: Clustering, Integration
            Reporter: Grant Ingersoll
            Assignee: Grant Ingersoll
            Priority: Minor
             Fix For: 0.6


When running the cluster dumper, or outputting values to a file for display purposes, it is useful to not have to deal with all the points per cluster.  This issue will add the ability to specify a maximum number of points to output per cluster in the cluster dumper.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAHOUT-899) Add Point Sampling, Color coding to ClusterDumper

Posted by "Lance Norskog (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAHOUT-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13158236#comment-13158236 ] 

Lance Norskog commented on MAHOUT-899:
--------------------------------------

Suggestion on sampling: use reservoir sampling instead of "first N". With a fixed seed.

Other ideas: 
* make edges directed based on distance from centroid. Given (n1, n2, e) and n1 is farther from the centroid than n2, make the edge point from n1 -> n2. This creates a cool partial ordering.
* add node/edge weights based on whatever is appropriate in the algorithm.
* add node weight based on distance.
* if vectors are NamedVector add the name as a node attribute.

I find Gephi baffling, but I'm sure an expert would find these cool additions.

                
> Add Point Sampling, Color coding to ClusterDumper
> -------------------------------------------------
>
>                 Key: MAHOUT-899
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-899
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Clustering, Integration
>            Reporter: Grant Ingersoll
>            Assignee: Grant Ingersoll
>            Priority: Minor
>             Fix For: 0.6
>
>         Attachments: MAHOUT-899.patch
>
>
> When running the cluster dumper, or outputting values to a file for display purposes, it is useful to not have to deal with all the points per cluster.  This issue will add the ability to specify a maximum number of points to output per cluster in the cluster dumper.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAHOUT-899) Add Point Sampling, Color coding to ClusterDumper

Posted by "Grant Ingersoll (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAHOUT-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13182286#comment-13182286 ] 

Grant Ingersoll commented on MAHOUT-899:
----------------------------------------

I'm going to commit what I have for now for this release, and then we can iterate
                
> Add Point Sampling, Color coding to ClusterDumper
> -------------------------------------------------
>
>                 Key: MAHOUT-899
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-899
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Clustering, Integration
>            Reporter: Grant Ingersoll
>            Assignee: Grant Ingersoll
>            Priority: Minor
>             Fix For: 0.6
>
>         Attachments: MAHOUT-899.patch, MAHOUT-899.patch
>
>
> When running the cluster dumper, or outputting values to a file for display purposes, it is useful to not have to deal with all the points per cluster.  This issue will add the ability to specify a maximum number of points to output per cluster in the cluster dumper.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAHOUT-899) Add Point Sampling, Color coding to ClusterDumper

Posted by "Grant Ingersoll (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAHOUT-899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Grant Ingersoll updated MAHOUT-899:
-----------------------------------

    Summary: Add Point Sampling, Color coding to ClusterDumper  (was: Add Point Sampling to ClusterDumper)
    
> Add Point Sampling, Color coding to ClusterDumper
> -------------------------------------------------
>
>                 Key: MAHOUT-899
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-899
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Clustering, Integration
>            Reporter: Grant Ingersoll
>            Assignee: Grant Ingersoll
>            Priority: Minor
>             Fix For: 0.6
>
>         Attachments: MAHOUT-899.patch
>
>
> When running the cluster dumper, or outputting values to a file for display purposes, it is useful to not have to deal with all the points per cluster.  This issue will add the ability to specify a maximum number of points to output per cluster in the cluster dumper.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (MAHOUT-899) Add Point Sampling, Color coding to ClusterDumper

Posted by "Grant Ingersoll (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAHOUT-899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Grant Ingersoll resolved MAHOUT-899.
------------------------------------

    Resolution: Fixed
    
> Add Point Sampling, Color coding to ClusterDumper
> -------------------------------------------------
>
>                 Key: MAHOUT-899
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-899
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Clustering, Integration
>            Reporter: Grant Ingersoll
>            Assignee: Grant Ingersoll
>            Priority: Minor
>             Fix For: 0.6
>
>         Attachments: MAHOUT-899.patch, MAHOUT-899.patch
>
>
> When running the cluster dumper, or outputting values to a file for display purposes, it is useful to not have to deal with all the points per cluster.  This issue will add the ability to specify a maximum number of points to output per cluster in the cluster dumper.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAHOUT-899) Add Point Sampling to ClusterDumper

Posted by "Grant Ingersoll (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAHOUT-899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Grant Ingersoll updated MAHOUT-899:
-----------------------------------

    Attachment: MAHOUT-899.patch

Adds point sampling, also adds coloring to the output of the graph ml writer
                
> Add Point Sampling to ClusterDumper
> -----------------------------------
>
>                 Key: MAHOUT-899
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-899
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Clustering, Integration
>            Reporter: Grant Ingersoll
>            Assignee: Grant Ingersoll
>            Priority: Minor
>             Fix For: 0.6
>
>         Attachments: MAHOUT-899.patch
>
>
> When running the cluster dumper, or outputting values to a file for display purposes, it is useful to not have to deal with all the points per cluster.  This issue will add the ability to specify a maximum number of points to output per cluster in the cluster dumper.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAHOUT-899) Add Point Sampling, Color coding to ClusterDumper

Posted by "Grant Ingersoll (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAHOUT-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13158354#comment-13158354 ] 

Grant Ingersoll commented on MAHOUT-899:
----------------------------------------

The last one is implemented already, you just need to turn on the labels in gephi.  I'll look into the weights thing.
                
> Add Point Sampling, Color coding to ClusterDumper
> -------------------------------------------------
>
>                 Key: MAHOUT-899
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-899
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Clustering, Integration
>            Reporter: Grant Ingersoll
>            Assignee: Grant Ingersoll
>            Priority: Minor
>             Fix For: 0.6
>
>         Attachments: MAHOUT-899.patch
>
>
> When running the cluster dumper, or outputting values to a file for display purposes, it is useful to not have to deal with all the points per cluster.  This issue will add the ability to specify a maximum number of points to output per cluster in the cluster dumper.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAHOUT-899) Add Point Sampling, Color coding to ClusterDumper

Posted by "Grant Ingersoll (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAHOUT-899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Grant Ingersoll updated MAHOUT-899:
-----------------------------------

    Attachment: MAHOUT-899.patch

Here's a lame attempt at laying out the clusters in 2D in the GraphMLCluster by simply placing points in a cluster around a centroid. Basically, it shows the relationship between a point and it's centroid, but should not be misconstrued to show anything else.  

I'm looking for better layout mechanisms.  Basically, need to be able to project an n-dimensional vector down to 2-D.  Ideas most welcome.  At a minimum, I like the refactoring done here.
                
> Add Point Sampling, Color coding to ClusterDumper
> -------------------------------------------------
>
>                 Key: MAHOUT-899
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-899
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Clustering, Integration
>            Reporter: Grant Ingersoll
>            Assignee: Grant Ingersoll
>            Priority: Minor
>             Fix For: 0.6
>
>         Attachments: MAHOUT-899.patch, MAHOUT-899.patch
>
>
> When running the cluster dumper, or outputting values to a file for display purposes, it is useful to not have to deal with all the points per cluster.  This issue will add the ability to specify a maximum number of points to output per cluster in the cluster dumper.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAHOUT-899) Add Point Sampling, Color coding to ClusterDumper

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAHOUT-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13182302#comment-13182302 ] 

Hudson commented on MAHOUT-899:
-------------------------------

Integrated in Mahout-Quality #1296 (See [https://builds.apache.org/job/Mahout-Quality/1296/])
    MAHOUT-899: Add some more cluster dumping options like sampling, coloring

gsingers : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1228948
Files : 
* /mahout/trunk/core/src/main/java/org/apache/mahout/common/StringUtils.java
* /mahout/trunk/core/src/test/java/org/apache/mahout/common/StringUtilsTest.java
* /mahout/trunk/integration/src/main/java/org/apache/mahout/utils/clustering/AbstractClusterWriter.java
* /mahout/trunk/integration/src/main/java/org/apache/mahout/utils/clustering/CSVClusterWriter.java
* /mahout/trunk/integration/src/main/java/org/apache/mahout/utils/clustering/ClusterDumper.java
* /mahout/trunk/integration/src/main/java/org/apache/mahout/utils/clustering/ClusterDumperWriter.java
* /mahout/trunk/integration/src/main/java/org/apache/mahout/utils/clustering/GraphMLClusterWriter.java

                
> Add Point Sampling, Color coding to ClusterDumper
> -------------------------------------------------
>
>                 Key: MAHOUT-899
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-899
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Clustering, Integration
>            Reporter: Grant Ingersoll
>            Assignee: Grant Ingersoll
>            Priority: Minor
>             Fix For: 0.6
>
>         Attachments: MAHOUT-899.patch, MAHOUT-899.patch
>
>
> When running the cluster dumper, or outputting values to a file for display purposes, it is useful to not have to deal with all the points per cluster.  This issue will add the ability to specify a maximum number of points to output per cluster in the cluster dumper.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira