You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Michael <mi...@gameservice.ru> on 2006/04/28 03:53:25 UTC

Problem with sorting index

When i'm trying to use IndexSorter, i'm getting this error:

Exception in thread "main" java.lang.IllegalArgumentException: attempt to access a deleted document
        at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:282)
        at org.apache.lucene.index.FilterIndexReader.document(FilterIndexReader.java:104)
        at org.apache.nutch.indexer.IndexSorter$SortingReader.document(IndexSorter.java:170)
        at org.apache.lucene.index.SegmentMerger.mergeFields(SegmentMerger.java:186)
        at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:88)
        at org.apache.lucene.index.IndexWriter.addIndexes(IndexWriter.java:579)
        at org.apache.nutch.indexer.IndexSorter.sort(IndexSorter.java:240)
        at org.apache.nutch.indexer.IndexSorter.main(IndexSorter.java:291)
        
Anyone knows how to fix this?
  

Michael

Re: Problem with sorting index

Posted by Doug Cutting <cu...@apache.org>.
It sounds like you're sorting a segment index after dedup, rather than a 
merged index.  It also looks like there's a bug in IndexSorter.  But you 
should be able to work around it by merging your segment indexes after 
deduping, so there are no deletions.

Please file a bug in Jira.

Doug

Michael wrote:
> When i'm trying to use IndexSorter, i'm getting this error:
> 
> Exception in thread "main" java.lang.IllegalArgumentException: attempt to access a deleted document
>         at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:282)
>         at org.apache.lucene.index.FilterIndexReader.document(FilterIndexReader.java:104)
>         at org.apache.nutch.indexer.IndexSorter$SortingReader.document(IndexSorter.java:170)
>         at org.apache.lucene.index.SegmentMerger.mergeFields(SegmentMerger.java:186)
>         at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:88)
>         at org.apache.lucene.index.IndexWriter.addIndexes(IndexWriter.java:579)
>         at org.apache.nutch.indexer.IndexSorter.sort(IndexSorter.java:240)
>         at org.apache.nutch.indexer.IndexSorter.main(IndexSorter.java:291)
>         
> Anyone knows how to fix this?
>   
> 
> Michael
>