You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Drew Farris (JIRA)" <ji...@apache.org> on 2010/05/27 18:02:38 UTC
[jira] Created: (MAHOUT-401) Use NamedVector in seq2sparse
Use NamedVector in seq2sparse
-----------------------------
Key: MAHOUT-401
URL: https://issues.apache.org/jira/browse/MAHOUT-401
Project: Mahout
Issue Type: Bug
Components: Utils
Affects Versions: 0.4
Reporter: Drew Farris
TFIDFPartialVectorReducer and TFPartialVectorReducer should write NamedVectors. (more detail later)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAHOUT-401) Use NamedVector in seq2sparse
Posted by "Drew Farris (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Drew Farris updated MAHOUT-401:
-------------------------------
Attachment: pv.patch
Jeff's patch posted to mahout user. Couldn't get this to apply cleanly to my local copy but didn't spend much time with it. Just sort of using this as a placeholder to revisit the issue.
> Use NamedVector in seq2sparse
> -----------------------------
>
> Key: MAHOUT-401
> URL: https://issues.apache.org/jira/browse/MAHOUT-401
> Project: Mahout
> Issue Type: Bug
> Components: Utils
> Affects Versions: 0.4
> Reporter: Drew Farris
> Attachments: pv.patch
>
>
> TFIDFPartialVectorReducer and TFPartialVectorReducer should write NamedVectors. (more detail later)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAHOUT-401) Use NamedVector in seq2sparse
Posted by "Drew Farris (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Drew Farris updated MAHOUT-401:
-------------------------------
Description:
In seq2sparse, TFIDFPartialVectorReducer and TFPartialVectorReducer should write NamedVectors. It appears that a lack of labels on the vector input to k-means at least breaks the cluster-dumper in the sense that it no longer prints the original document ids for points.
See: http://lucene.472066.n3.nabble.com/where-are-the-points-in-each-cluster-kmeans-clusterdump-td838683.html#a845600
I wonder if this is also an issue with the code that generates vectors from lucene indexes?
was:
TFIDFPartialVectorReducer and TFPartialVectorReducer should write NamedVectors. (more detail later)
> Use NamedVector in seq2sparse
> -----------------------------
>
> Key: MAHOUT-401
> URL: https://issues.apache.org/jira/browse/MAHOUT-401
> Project: Mahout
> Issue Type: Bug
> Components: Utils
> Affects Versions: 0.4
> Reporter: Drew Farris
> Attachments: MAHOUT-401.patch, pv.patch
>
>
> In seq2sparse, TFIDFPartialVectorReducer and TFPartialVectorReducer should write NamedVectors. It appears that a lack of labels on the vector input to k-means at least breaks the cluster-dumper in the sense that it no longer prints the original document ids for points.
> See: http://lucene.472066.n3.nabble.com/where-are-the-points-in-each-cluster-kmeans-clusterdump-td838683.html#a845600
> I wonder if this is also an issue with the code that generates vectors from lucene indexes?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAHOUT-401) Use NamedVector in seq2sparse
Posted by "Drew Farris (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Drew Farris updated MAHOUT-401:
-------------------------------
Attachment: MAHOUT-401.patch
This also patches PartialVectorMergeReducer -- I believe this captures the 3 main cases where non-named vectors are created in the seq2sparse output.
> Use NamedVector in seq2sparse
> -----------------------------
>
> Key: MAHOUT-401
> URL: https://issues.apache.org/jira/browse/MAHOUT-401
> Project: Mahout
> Issue Type: Bug
> Components: Utils
> Affects Versions: 0.4
> Reporter: Drew Farris
> Attachments: MAHOUT-401.patch, pv.patch
>
>
> TFIDFPartialVectorReducer and TFPartialVectorReducer should write NamedVectors. (more detail later)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.