You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Hai To (JIRA)" <ji...@apache.org> on 2013/10/23 18:05:48 UTC
[jira] [Comment Edited] (MAHOUT-944) LuceneIndexToSequenceFiles
(lucene2seq) utility
[ https://issues.apache.org/jira/browse/MAHOUT-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13802980#comment-13802980 ]
Hai To edited comment on MAHOUT-944 at 10/23/13 4:05 PM:
---------------------------------------------------------
Is it intended that wildcard queries are not supported?
{code}
13/10/23 15:05:46 INFO mapred.JobClient: Task Id : attempt_201310210841_18260_m_000004_2, Status : FAILED
java.lang.UnsupportedOperationException: Query lang:de* does not implement createWeight
at org.apache.lucene.search.Query.createWeight(Query.java:80)
at org.apache.mahout.text.LuceneSegmentRecordReader.initialize(LuceneSegmentRecordReader.java:60)
at org.apache.mahout.text.LuceneSegmentInputFormat.createRecordReader(LuceneSegmentInputFormat.java:76)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:644)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
at org.apache.hadoop.mapred.Child.main(Child.java:262)
{code}
was (Author: n0rritt):
Is it intended that wildcard queries are not supported?
13/10/23 15:05:46 INFO mapred.JobClient: Task Id : attempt_201310210841_18260_m_000004_2, Status : FAILED
java.lang.UnsupportedOperationException: Query lang:de* does not implement createWeight
at org.apache.lucene.search.Query.createWeight(Query.java:80)
at org.apache.mahout.text.LuceneSegmentRecordReader.initialize(LuceneSegmentRecordReader.java:60)
at org.apache.mahout.text.LuceneSegmentInputFormat.createRecordReader(LuceneSegmentInputFormat.java:76)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:644)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
at org.apache.hadoop.mapred.Child.main(Child.java:262)
> LuceneIndexToSequenceFiles (lucene2seq) utility
> -----------------------------------------------
>
> Key: MAHOUT-944
> URL: https://issues.apache.org/jira/browse/MAHOUT-944
> Project: Mahout
> Issue Type: New Feature
> Components: Integration
> Affects Versions: 0.5
> Reporter: Frank Scholten
> Assignee: Grant Ingersoll
> Priority: Minor
> Fix For: 0.8
>
> Attachments: MAHOUT-944-minor.patch, MAHOUT-944.patch, MAHOUT-944.patch, MAHOUT-944.patch, MAHOUT-944.patch, MAHOUT-944.patch, MAHOUT-944.patch, MAHOUT-944.patch, MAHOUT-944.patch, MAHOUT-944.patch, MAHOUT-944.patch, MAHOUT-944.patch, MAHOUT-944.patch
>
>
> Here is a lucene2seq tool I used in a project. It creates sequence files based on the stored fields of a lucene index.
> The output from this tool can be then fed into seq2sparse and from there you can do text clustering.
> Comes with Java bean configuration.
> Let me know what you think. Some CLI code can be added later on. I used this for a small-scale project +- 100.000 docs. Is a MR version useful or is that overkill?
> See https://github.com/frankscholten/mahout/tree/lucene2seq for commits and review comments from Simon Willnauer (Thanks Simon!)
> or the attached patch.
--
This message was sent by Atlassian JIRA
(v6.1#6144)