You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Andrew Zhang (JIRA)" <ji...@apache.org> on 2008/11/16 05:09:44 UTC

[jira] Created: (LUCENE-1454) Corrupted index produced by lucene 2.4

Corrupted index produced by lucene 2.4
--------------------------------------

                 Key: LUCENE-1454
                 URL: https://issues.apache.org/jira/browse/LUCENE-1454
             Project: Lucene - Java
          Issue Type: Bug
          Components: Index
    Affects Versions: 2.4
            Reporter: Andrew Zhang
         Attachments: index.zip

Hi,

I found corrupted index produced by lucene-2.4. I can't find a way to reproduce it. My machine was shutdown abnormally when the application was running.

The corrupted index is attached.  Would anyone please take a look? Thanks a lot!

Environment: Windows XP, Service Pack 2

jre: Apache Harmony



-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Updated: (LUCENE-1454) Corrupted index produced by lucene 2.4

Posted by "Andrew Zhang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Zhang updated LUCENE-1454:
---------------------------------

    Description: 
Hi,

I found corrupted index produced by lucene-2.4. I can't find a way to reproduce it. My machine was shutdown abnormally when the application was running.

The corrupted index is attached.  Would anyone please take a look? Thanks a lot!

Environment: Windows XP, Service Pack 2



  was:
Hi,

I found corrupted index produced by lucene-2.4. I can't find a way to reproduce it. My machine was shutdown abnormally when the application was running.

The corrupted index is attached.  Would anyone please take a look? Thanks a lot!

Environment: Windows XP, Service Pack 2

jre: Apache Harmony




> Corrupted index produced by lucene 2.4
> --------------------------------------
>
>                 Key: LUCENE-1454
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1454
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: Index
>    Affects Versions: 2.4
>            Reporter: Andrew Zhang
>         Attachments: index.zip
>
>
> Hi,
> I found corrupted index produced by lucene-2.4. I can't find a way to reproduce it. My machine was shutdown abnormally when the application was running.
> The corrupted index is attached.  Would anyone please take a look? Thanks a lot!
> Environment: Windows XP, Service Pack 2

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-1454) Corrupted index produced by lucene 2.4

Posted by "Andrew Zhang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647963#action_12647963 ] 

Andrew Zhang commented on LUCENE-1454:
--------------------------------------

Michael McCandless - 16/Nov/08 05:02 AM
Andrew Zhang - 16/Nov/08 05:02 AM

:) I'll close the jira. Thanks!

> Corrupted index produced by lucene 2.4
> --------------------------------------
>
>                 Key: LUCENE-1454
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1454
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: Index
>    Affects Versions: 2.4
>            Reporter: Andrew Zhang
>         Attachments: index.zip
>
>
> Hi,
> I found corrupted index produced by lucene-2.4. I can't find a way to reproduce it. My machine was shutdown abnormally when the application was running.
> The corrupted index is attached.  Would anyone please take a look? Thanks a lot!
> Environment: Windows XP, Service Pack 2

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Updated: (LUCENE-1454) Corrupted index produced by lucene 2.4

Posted by "Andrew Zhang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Zhang updated LUCENE-1454:
---------------------------------

    Attachment: index.zip

> Corrupted index produced by lucene 2.4
> --------------------------------------
>
>                 Key: LUCENE-1454
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1454
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: Index
>    Affects Versions: 2.4
>            Reporter: Andrew Zhang
>         Attachments: index.zip
>
>
> Hi,
> I found corrupted index produced by lucene-2.4. I can't find a way to reproduce it. My machine was shutdown abnormally when the application was running.
> The corrupted index is attached.  Would anyone please take a look? Thanks a lot!
> Environment: Windows XP, Service Pack 2
> jre: Apache Harmony

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-1454) Corrupted index produced by lucene 2.4

Posted by "Andrew Zhang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647961#action_12647961 ] 

Andrew Zhang commented on LUCENE-1454:
--------------------------------------

After looking at the source code of Luke.java, ~Ln 800:

fn = ir.getFieldNames(IndexReader.FieldOption.ALL);
      if (fn.size() == 0) {
        errorMsg("Invalid or corrupted index.");
        return;
      }

It seems that normal empty index will be reported as "Invalid or corrupted index". 

I tried to create an empty index, and luke prompted "Invalid or corrupted index" as well.

Thanks for your time, Michael!

> Corrupted index produced by lucene 2.4
> --------------------------------------
>
>                 Key: LUCENE-1454
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1454
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: Index
>    Affects Versions: 2.4
>            Reporter: Andrew Zhang
>         Attachments: index.zip
>
>
> Hi,
> I found corrupted index produced by lucene-2.4. I can't find a way to reproduce it. My machine was shutdown abnormally when the application was running.
> The corrupted index is attached.  Would anyone please take a look? Thanks a lot!
> Environment: Windows XP, Service Pack 2

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Re: Luke bugs (Re: [jira] Commented: (LUCENE-1454) Corrupted index produced by lucene 2.4)

Posted by Michael McCandless <lu...@mikemccandless.com>.
OK will do :)  Nice that you're paying attention!

Mike

Andrzej Bialecki wrote:

> Michael McCandless (JIRA) wrote:
>>    [ https://issues.apache.org/jira/browse/LUCENE-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647960 
>> #action_12647960 ] Michael McCandless commented on LUCENE-1454:
>> --------------------------------------------
>> You're right, Luke is saying that!
>> But, that's a misleading error -- here are the sources in Luke for  
>> that error:
>> {code}
>> fn = ir.getFieldNames(IndexReader.FieldOption.ALL);
>> if (fn.size() == 0) {
>>    errorMsg("Invalid or corrupted index.");
>>    return;
>> }
>> {code}
>> So, what Luke really means is there are 0 fields found in the  
>> index, ie it's an empty index.
>
> You're lucky that I spotted this message ... ;)
>
> I'll fix it in the next minor release of Luke, pretty soon.
>
> However, in the future please notify me about any suspected bugs in  
> Luke, otherwise I may miss reports like this.
>
> -- 
> Best regards,
> Andrzej Bialecki     <><
> ___. ___ ___ ___ _ _   __________________________________
> [__ || __|__/|__||\/|  Information Retrieval, Semantic Web
> ___|||__||  \|  ||  |  Embedded Unix, System Integration
> http://www.sigram.com  Contact: info at sigram dot com
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-dev-help@lucene.apache.org
>


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Luke bugs (Re: [jira] Commented: (LUCENE-1454) Corrupted index produced by lucene 2.4)

Posted by Andrzej Bialecki <ab...@getopt.org>.
Michael McCandless (JIRA) wrote:
>     [ https://issues.apache.org/jira/browse/LUCENE-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647960#action_12647960 ] 
> 
> Michael McCandless commented on LUCENE-1454:
> --------------------------------------------
> 
> You're right, Luke is saying that!
> 
> But, that's a misleading error -- here are the sources in Luke for that error:
> 
> {code}
> fn = ir.getFieldNames(IndexReader.FieldOption.ALL);
> if (fn.size() == 0) {
>     errorMsg("Invalid or corrupted index.");
>     return;
> }
> {code}
> 
> So, what Luke really means is there are 0 fields found in the index, ie it's an empty index.

You're lucky that I spotted this message ... ;)

I'll fix it in the next minor release of Luke, pretty soon.

However, in the future please notify me about any suspected bugs in 
Luke, otherwise I may miss reports like this.

-- 
Best regards,
Andrzej Bialecki     <><
  ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-1454) Corrupted index produced by lucene 2.4

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647960#action_12647960 ] 

Michael McCandless commented on LUCENE-1454:
--------------------------------------------

You're right, Luke is saying that!

But, that's a misleading error -- here are the sources in Luke for that error:

{code}
fn = ir.getFieldNames(IndexReader.FieldOption.ALL);
if (fn.size() == 0) {
    errorMsg("Invalid or corrupted index.");
    return;
}
{code}

So, what Luke really means is there are 0 fields found in the index, ie it's an empty index.

> Corrupted index produced by lucene 2.4
> --------------------------------------
>
>                 Key: LUCENE-1454
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1454
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: Index
>    Affects Versions: 2.4
>            Reporter: Andrew Zhang
>         Attachments: index.zip
>
>
> Hi,
> I found corrupted index produced by lucene-2.4. I can't find a way to reproduce it. My machine was shutdown abnormally when the application was running.
> The corrupted index is attached.  Would anyone please take a look? Thanks a lot!
> Environment: Windows XP, Service Pack 2

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Closed: (LUCENE-1454) Corrupted index produced by lucene 2.4

Posted by "Andrew Zhang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Zhang closed LUCENE-1454.
--------------------------------

    Resolution: Invalid

The index is not corrupted. Caused by the misleading message given by luke when opening an empty index.

> Corrupted index produced by lucene 2.4
> --------------------------------------
>
>                 Key: LUCENE-1454
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1454
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: Index
>    Affects Versions: 2.4
>            Reporter: Andrew Zhang
>         Attachments: index.zip
>
>
> Hi,
> I found corrupted index produced by lucene-2.4. I can't find a way to reproduce it. My machine was shutdown abnormally when the application was running.
> The corrupted index is attached.  Would anyone please take a look? Thanks a lot!
> Environment: Windows XP, Service Pack 2

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-1454) Corrupted index produced by lucene 2.4

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647943#action_12647943 ] 

Michael McCandless commented on LUCENE-1454:
--------------------------------------------

Hmm -- I unzipped the index, and ran CheckIndex on it, and it did not report any exception.

There is a leftover write.lock, which you'll need to remove before opening another writer.

Can you post the full exception you're hitting?

> Corrupted index produced by lucene 2.4
> --------------------------------------
>
>                 Key: LUCENE-1454
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1454
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: Index
>    Affects Versions: 2.4
>            Reporter: Andrew Zhang
>         Attachments: index.zip
>
>
> Hi,
> I found corrupted index produced by lucene-2.4. I can't find a way to reproduce it. My machine was shutdown abnormally when the application was running.
> The corrupted index is attached.  Would anyone please take a look? Thanks a lot!
> Environment: Windows XP, Service Pack 2

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-1454) Corrupted index produced by lucene 2.4

Posted by "Andrew Zhang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647957#action_12647957 ] 

Andrew Zhang commented on LUCENE-1454:
--------------------------------------

Thanks Michael!

Interesting. CheckIndex shows the index is OK, while Luke (both 0.8.1 and 0.9) shows "Invalid or  corrupted index". 

Luke "Tools -> Check index tool" also shows no problem of the index. 

Looks like a bug of Luke "Open Index". I'll take a close look soon. Thanks again!

> Corrupted index produced by lucene 2.4
> --------------------------------------
>
>                 Key: LUCENE-1454
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1454
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: Index
>    Affects Versions: 2.4
>            Reporter: Andrew Zhang
>         Attachments: index.zip
>
>
> Hi,
> I found corrupted index produced by lucene-2.4. I can't find a way to reproduce it. My machine was shutdown abnormally when the application was running.
> The corrupted index is attached.  Would anyone please take a look? Thanks a lot!
> Environment: Windows XP, Service Pack 2

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org