You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Frank Scholten (Commented) (JIRA)" <ji...@apache.org> on 2012/02/06 17:59:59 UTC
[jira] [Commented] (MAHOUT-944) LuceneIndexToSequenceFiles
(lucene2seq) utility
[ https://issues.apache.org/jira/browse/MAHOUT-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13201395#comment-13201395 ]
Frank Scholten commented on MAHOUT-944:
---------------------------------------
Started working on CLI code. Still have to support lucene queries as a parameter. I think it would be cool to add field separators in between the contents of the field and the extra fields. That way this tool also be used as an entry point into seq2encoded.
See https://github.com/frankscholten/mahout/commit/25584aac9dc0727ebc86ae245768f592161d4813
> LuceneIndexToSequenceFiles (lucene2seq) utility
> -----------------------------------------------
>
> Key: MAHOUT-944
> URL: https://issues.apache.org/jira/browse/MAHOUT-944
> Project: Mahout
> Issue Type: New Feature
> Components: Integration
> Affects Versions: 0.5
> Reporter: Frank Scholten
> Priority: Minor
> Fix For: 0.7
>
> Attachments: MAHOUT-944.patch
>
>
> Here is a lucene2seq tool I used in a project. It creates sequence files based on the stored fields of a lucene index.
> The output from this tool can be then fed into seq2sparse and from there you can do text clustering.
> Comes with Java bean configuration.
> Let me know what you think. Some CLI code can be added later on. I used this for a small-scale project +- 100.000 docs. Is a MR version useful or is that overkill?
> See https://github.com/frankscholten/mahout/tree/lucene2seq for commits and review comments from Simon Willnauer (Thanks Simon!)
> or the attached patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira