You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Shashikant Kore (JIRA)" <ji...@apache.org> on 2009/08/06 08:55:14 UTC
[jira] Created: (MAHOUT-160) ClusterDumper utility to output all
the clusters in all sequence files and points
ClusterDumper utility to output all the clusters in all sequence files and points
---------------------------------------------------------------------------------
Key: MAHOUT-160
URL: https://issues.apache.org/jira/browse/MAHOUT-160
Project: Mahout
Issue Type: Improvement
Reporter: Shashikant Kore
The current ClusterDumper utility takes a sequence file and points file as input and prints the cluster vector along with the points that belong to the clusters in the sequence file. This utility doesn't produce correct results in case there are multiple sequence files and points.
To avoid this problem, all the point to cluster mappings need to be read first and then iterate on the sequence files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAHOUT-160) ClusterDumper utility to output all
the clusters in all sequence files and points
Posted by "Grant Ingersoll (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Grant Ingersoll updated MAHOUT-160:
-----------------------------------
Fix Version/s: 0.2
> ClusterDumper utility to output all the clusters in all sequence files and points
> ---------------------------------------------------------------------------------
>
> Key: MAHOUT-160
> URL: https://issues.apache.org/jira/browse/MAHOUT-160
> Project: Mahout
> Issue Type: Improvement
> Reporter: Shashikant Kore
> Assignee: Grant Ingersoll
> Fix For: 0.2
>
> Attachments: mahout-160-dict.patch, mahout-160.patch
>
>
> The current ClusterDumper utility takes a sequence file and points file as input and prints the cluster vector along with the points that belong to the clusters in the sequence file. This utility doesn't produce correct results in case there are multiple sequence files and points.
> To avoid this problem, all the point to cluster mappings need to be read first and then iterate on the sequence files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-160) ClusterDumper utility to output all
the clusters in all sequence files and points
Posted by "Shashikant Kore (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12756488#action_12756488 ]
Shashikant Kore commented on MAHOUT-160:
----------------------------------------
Yeah, this can be closed.
> ClusterDumper utility to output all the clusters in all sequence files and points
> ---------------------------------------------------------------------------------
>
> Key: MAHOUT-160
> URL: https://issues.apache.org/jira/browse/MAHOUT-160
> Project: Mahout
> Issue Type: Improvement
> Reporter: Shashikant Kore
> Assignee: Grant Ingersoll
> Fix For: 0.2
>
> Attachments: mahout-160-dict.patch, mahout-160.patch
>
>
> The current ClusterDumper utility takes a sequence file and points file as input and prints the cluster vector along with the points that belong to the clusters in the sequence file. This utility doesn't produce correct results in case there are multiple sequence files and points.
> To avoid this problem, all the point to cluster mappings need to be read first and then iterate on the sequence files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAHOUT-160) ClusterDumper utility to output all
the clusters in all sequence files and points
Posted by "Shashikant Kore (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shashikant Kore updated MAHOUT-160:
-----------------------------------
Attachment: mahout-160.patch
ClusterDumper utility has been modified to take the clusters and points directory as input instead of sequence file and points file.
> ClusterDumper utility to output all the clusters in all sequence files and points
> ---------------------------------------------------------------------------------
>
> Key: MAHOUT-160
> URL: https://issues.apache.org/jira/browse/MAHOUT-160
> Project: Mahout
> Issue Type: Improvement
> Reporter: Shashikant Kore
> Attachments: mahout-160.patch
>
>
> The current ClusterDumper utility takes a sequence file and points file as input and prints the cluster vector along with the points that belong to the clusters in the sequence file. This utility doesn't produce correct results in case there are multiple sequence files and points.
> To avoid this problem, all the point to cluster mappings need to be read first and then iterate on the sequence files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-160) ClusterDumper utility to output all
the clusters in all sequence files and points
Posted by "Grant Ingersoll (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12740090#action_12740090 ]
Grant Ingersoll commented on MAHOUT-160:
----------------------------------------
Committed revision 801661.
> ClusterDumper utility to output all the clusters in all sequence files and points
> ---------------------------------------------------------------------------------
>
> Key: MAHOUT-160
> URL: https://issues.apache.org/jira/browse/MAHOUT-160
> Project: Mahout
> Issue Type: Improvement
> Reporter: Shashikant Kore
> Assignee: Grant Ingersoll
> Attachments: mahout-160-dict.patch, mahout-160.patch
>
>
> The current ClusterDumper utility takes a sequence file and points file as input and prints the cluster vector along with the points that belong to the clusters in the sequence file. This utility doesn't produce correct results in case there are multiple sequence files and points.
> To avoid this problem, all the point to cluster mappings need to be read first and then iterate on the sequence files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (MAHOUT-160) ClusterDumper utility to output all
the clusters in all sequence files and points
Posted by "Grant Ingersoll (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Grant Ingersoll reassigned MAHOUT-160:
--------------------------------------
Assignee: Grant Ingersoll
> ClusterDumper utility to output all the clusters in all sequence files and points
> ---------------------------------------------------------------------------------
>
> Key: MAHOUT-160
> URL: https://issues.apache.org/jira/browse/MAHOUT-160
> Project: Mahout
> Issue Type: Improvement
> Reporter: Shashikant Kore
> Assignee: Grant Ingersoll
> Attachments: mahout-160-dict.patch, mahout-160.patch
>
>
> The current ClusterDumper utility takes a sequence file and points file as input and prints the cluster vector along with the points that belong to the clusters in the sequence file. This utility doesn't produce correct results in case there are multiple sequence files and points.
> To avoid this problem, all the point to cluster mappings need to be read first and then iterate on the sequence files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-160) ClusterDumper utility to output all
the clusters in all sequence files and points
Posted by "Isabel Drost (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12754963#action_12754963 ]
Isabel Drost commented on MAHOUT-160:
-------------------------------------
If that is committed - can we close the issue?
> ClusterDumper utility to output all the clusters in all sequence files and points
> ---------------------------------------------------------------------------------
>
> Key: MAHOUT-160
> URL: https://issues.apache.org/jira/browse/MAHOUT-160
> Project: Mahout
> Issue Type: Improvement
> Reporter: Shashikant Kore
> Assignee: Grant Ingersoll
> Fix For: 0.2
>
> Attachments: mahout-160-dict.patch, mahout-160.patch
>
>
> The current ClusterDumper utility takes a sequence file and points file as input and prints the cluster vector along with the points that belong to the clusters in the sequence file. This utility doesn't produce correct results in case there are multiple sequence files and points.
> To avoid this problem, all the point to cluster mappings need to be read first and then iterate on the sequence files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAHOUT-160) ClusterDumper utility to output all
the clusters in all sequence files and points
Posted by "Shashikant Kore (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shashikant Kore updated MAHOUT-160:
-----------------------------------
Attachment: mahout-160-dict.patch
This patch accepts the term dictionary (created while creating document vectors) and along with the centroid vector and points of the cluster, it also prints top 10 features of the vector.
Couple of improvements can be done to this patch (a) delimiter is hard coded to tab. That could come as user input (b) Currently top 10 terms of the vector are printed. It could be a configurable number.
I will update the patch again, if this feature is deemed useful.
> ClusterDumper utility to output all the clusters in all sequence files and points
> ---------------------------------------------------------------------------------
>
> Key: MAHOUT-160
> URL: https://issues.apache.org/jira/browse/MAHOUT-160
> Project: Mahout
> Issue Type: Improvement
> Reporter: Shashikant Kore
> Attachments: mahout-160-dict.patch, mahout-160.patch
>
>
> The current ClusterDumper utility takes a sequence file and points file as input and prints the cluster vector along with the points that belong to the clusters in the sequence file. This utility doesn't produce correct results in case there are multiple sequence files and points.
> To avoid this problem, all the point to cluster mappings need to be read first and then iterate on the sequence files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (MAHOUT-160) ClusterDumper utility to output all
the clusters in all sequence files and points
Posted by "Grant Ingersoll (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Grant Ingersoll resolved MAHOUT-160.
------------------------------------
Resolution: Fixed
> ClusterDumper utility to output all the clusters in all sequence files and points
> ---------------------------------------------------------------------------------
>
> Key: MAHOUT-160
> URL: https://issues.apache.org/jira/browse/MAHOUT-160
> Project: Mahout
> Issue Type: Improvement
> Reporter: Shashikant Kore
> Assignee: Grant Ingersoll
> Fix For: 0.2
>
> Attachments: mahout-160-dict.patch, mahout-160.patch
>
>
> The current ClusterDumper utility takes a sequence file and points file as input and prints the cluster vector along with the points that belong to the clusters in the sequence file. This utility doesn't produce correct results in case there are multiple sequence files and points.
> To avoid this problem, all the point to cluster mappings need to be read first and then iterate on the sequence files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.