You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Robert Muir (JIRA)" <ji...@apache.org> on 2011/04/18 22:47:05 UTC

[jira] [Created] (LUCENE-3036) TestFSTs.testRealTerms is a terrible unit test

TestFSTs.testRealTerms is a terrible unit test
----------------------------------------------

                 Key: LUCENE-3036
                 URL: https://issues.apache.org/jira/browse/LUCENE-3036
             Project: Lucene - Java
          Issue Type: Bug
            Reporter: Robert Muir


This test:
* uses FSDirectory.open (platform-specific behavior)
* is a random test, but runs to a certain amount of seconds, then quits (makes it hard to reproduce with seed, as its behavior is dependent on your computers speed etc)

After waiting 3 hours to download the 1 gigabyte file to reproduce the corrupt index it made in (https://hudson.apache.org/hudson/job/Lucene-trunk/1533/testReport/junit/org.apache.lucene.util.automaton.fst/TestFSTs/testRealTerms/), I found some of this frustrating.

I managed to finally reproduce it but its no fun fiddling with a test that runs for 5 minutes to reproduce a fail.


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (LUCENE-3036) TestFSTs.testRealTerms is a terrible unit test

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Muir updated LUCENE-3036:
--------------------------------

    Attachment: LUCENE-3036.patch

here's a patch that makes the test work in reproducible fashion

> TestFSTs.testRealTerms is a terrible unit test
> ----------------------------------------------
>
>                 Key: LUCENE-3036
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3036
>             Project: Lucene - Java
>          Issue Type: Bug
>            Reporter: Robert Muir
>         Attachments: LUCENE-3036.patch
>
>
> This test:
> * uses FSDirectory.open (platform-specific behavior)
> * is a random test, but runs to a certain amount of seconds, then quits (makes it hard to reproduce with seed, as its behavior is dependent on your computers speed etc)
> After waiting 3 hours to download the 1 gigabyte file to reproduce the corrupt index it made in (https://hudson.apache.org/hudson/job/Lucene-trunk/1533/testReport/junit/org.apache.lucene.util.automaton.fst/TestFSTs/testRealTerms/), I found some of this frustrating.
> I managed to finally reproduce it but its no fun fiddling with a test that runs for 5 minutes to reproduce a fail.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (LUCENE-3036) TestFSTs.testRealTerms is a terrible unit test

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13021248#comment-13021248 ] 

Robert Muir commented on LUCENE-3036:
-------------------------------------

also, i don't like that the test data file hudson uses for nightly tests seems to only be available on hudson itself. this limits debugging fails to pmc members. we should put this file somewhere public.

> TestFSTs.testRealTerms is a terrible unit test
> ----------------------------------------------
>
>                 Key: LUCENE-3036
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3036
>             Project: Lucene - Java
>          Issue Type: Bug
>            Reporter: Robert Muir
>
> This test:
> * uses FSDirectory.open (platform-specific behavior)
> * is a random test, but runs to a certain amount of seconds, then quits (makes it hard to reproduce with seed, as its behavior is dependent on your computers speed etc)
> After waiting 3 hours to download the 1 gigabyte file to reproduce the corrupt index it made in (https://hudson.apache.org/hudson/job/Lucene-trunk/1533/testReport/junit/org.apache.lucene.util.automaton.fst/TestFSTs/testRealTerms/), I found some of this frustrating.
> I managed to finally reproduce it but its no fun fiddling with a test that runs for 5 minutes to reproduce a fail.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (LUCENE-3036) TestFSTs.testRealTerms is a terrible unit test

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Muir updated LUCENE-3036:
--------------------------------

    Summary: TestFSTs.testRealTerms is a terrible unit test  (was: improve TestFSTs.testRealTerms)

> TestFSTs.testRealTerms is a terrible unit test
> ----------------------------------------------
>
>                 Key: LUCENE-3036
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3036
>             Project: Lucene - Java
>          Issue Type: Bug
>            Reporter: Robert Muir
>
> This test:
> * uses FSDirectory.open (platform-specific behavior)
> * is a random test, but runs to a certain amount of seconds, then quits (makes it hard to reproduce with seed, as its behavior is dependent on your computers speed etc)
> After waiting 3 hours to download the 1 gigabyte file to reproduce the corrupt index it made in (https://hudson.apache.org/hudson/job/Lucene-trunk/1533/testReport/junit/org.apache.lucene.util.automaton.fst/TestFSTs/testRealTerms/), I found some of this frustrating.
> I managed to finally reproduce it but its no fun fiddling with a test that runs for 5 minutes to reproduce a fail.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (LUCENE-3036) TestFSTs.testRealTerms is a terrible unit test

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13023610#comment-13023610 ] 

Michael McCandless commented on LUCENE-3036:
--------------------------------------------

Patch looks good!

> TestFSTs.testRealTerms is a terrible unit test
> ----------------------------------------------
>
>                 Key: LUCENE-3036
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3036
>             Project: Lucene - Java
>          Issue Type: Bug
>            Reporter: Robert Muir
>         Attachments: LUCENE-3036.patch
>
>
> This test:
> * uses FSDirectory.open (platform-specific behavior)
> * is a random test, but runs to a certain amount of seconds, then quits (makes it hard to reproduce with seed, as its behavior is dependent on your computers speed etc)
> After waiting 3 hours to download the 1 gigabyte file to reproduce the corrupt index it made in (https://hudson.apache.org/hudson/job/Lucene-trunk/1533/testReport/junit/org.apache.lucene.util.automaton.fst/TestFSTs/testRealTerms/), I found some of this frustrating.
> I managed to finally reproduce it but its no fun fiddling with a test that runs for 5 minutes to reproduce a fail.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (LUCENE-3036) improve TestFSTs.testRealTerms

Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yonik Seeley updated LUCENE-3036:
---------------------------------

    Summary: improve TestFSTs.testRealTerms  (was: TestFSTs.testRealTerms is a terrible unit test)

> improve TestFSTs.testRealTerms
> ------------------------------
>
>                 Key: LUCENE-3036
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3036
>             Project: Lucene - Java
>          Issue Type: Bug
>            Reporter: Robert Muir
>
> This test:
> * uses FSDirectory.open (platform-specific behavior)
> * is a random test, but runs to a certain amount of seconds, then quits (makes it hard to reproduce with seed, as its behavior is dependent on your computers speed etc)
> After waiting 3 hours to download the 1 gigabyte file to reproduce the corrupt index it made in (https://hudson.apache.org/hudson/job/Lucene-trunk/1533/testReport/junit/org.apache.lucene.util.automaton.fst/TestFSTs/testRealTerms/), I found some of this frustrating.
> I managed to finally reproduce it but its no fun fiddling with a test that runs for 5 minutes to reproduce a fail.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org