You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Michael McCandless <lu...@mikemccandless.com> on 2015/03/15 21:58:39 UTC

2B tests

I confirmed 2B tests are passing on 4.10.x.  Took 17 hours to run ...
this is the command I run, for future reference:

  ant test -Dtests.monster=true -Dtests.heapsize=30g -Dtests.jvms=1
-Dtests.workDir=/p/tmp

Mike McCandless

http://blog.mikemccandless.com

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


RE: 2B tests

Posted by Uwe Schindler <uw...@thetaphi.de>.
2B = Two Billion... docs, terms, postings,...

Uwe

-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de


> -----Original Message-----
> From: Michael Wechner [mailto:michael.wechner@wyona.com]
> Sent: Monday, March 16, 2015 7:43 AM
> To: dev@lucene.apache.org
> Subject: Re: 2B tests
> 
> what are the "2B tests"? I guess the entry point is
> 
> lucene/core/src/test/org/apache/lucene/index/Test2BTerms.java
> 
> or where would you start to learn more about these tests?
> 
> Thanks
> 
> Michael
> 
> 
> Am 15.03.15 um 21:58 schrieb Michael McCandless:
> > I confirmed 2B tests are passing on 4.10.x.  Took 17 hours to run ...
> > this is the command I run, for future reference:
> >
> >   ant test -Dtests.monster=true -Dtests.heapsize=30g -Dtests.jvms=1
> > -Dtests.workDir=/p/tmp
> >
> > Mike McCandless
> >
> > http://blog.mikemccandless.com
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For
> > additional commands, e-mail: dev-help@lucene.apache.org
> >
> 
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional
> commands, e-mail: dev-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: 2B tests

Posted by Michael Wechner <mi...@wyona.com>.
thank you very much for clarifying

Michael

Am 16.03.15 um 17:24 schrieb Michael McCandless:
> The 2B tests are tests that confirm that Lucene's "limits" are working
> correctly, e.g. 2B docs, huge FSTs, many terms, many postings, etc.
>
> They are very slow to run and very heap-consuming so we don't run them
> by default when you run "ant test".
>
> Look for the @Monster annotation to see all of them...
>
> Mike McCandless
>
> http://blog.mikemccandless.com
>
>
> On Sun, Mar 15, 2015 at 11:42 PM, Michael Wechner
> <mi...@wyona.com> wrote:
>> what are the "2B tests"? I guess the entry point is
>>
>> lucene/core/src/test/org/apache/lucene/index/Test2BTerms.java
>>
>> or where would you start to learn more about these tests?
>>
>> Thanks
>>
>> Michael
>>
>>
>> Am 15.03.15 um 21:58 schrieb Michael McCandless:
>>> I confirmed 2B tests are passing on 4.10.x.  Took 17 hours to run ...
>>> this is the command I run, for future reference:
>>>
>>>   ant test -Dtests.monster=true -Dtests.heapsize=30g -Dtests.jvms=1
>>> -Dtests.workDir=/p/tmp
>>>
>>> Mike McCandless
>>>
>>> http://blog.mikemccandless.com
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: dev-help@lucene.apache.org
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: 2B tests

Posted by Michael McCandless <lu...@mikemccandless.com>.
On Mon, Mar 16, 2015 at 9:32 AM, Shawn Heisey <ap...@elyograg.org> wrote:
> On 3/16/2015 10:24 AM, Michael McCandless wrote:
>> Look for the @Monster annotation to see all of them...
>
> Tangent question:  Is there any way to ask JUnit to *only* run tests
> with a certain annotation, so that we could ask it to only run @Monster
> tests (or some other annotation like @Weekly)?

I would like to know too!  Dawid?

Mike McCandless

http://blog.mikemccandless.com

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: 2B tests

Posted by Shawn Heisey <ap...@elyograg.org>.
On 3/16/2015 10:24 AM, Michael McCandless wrote:
> Look for the @Monster annotation to see all of them...

Tangent question:  Is there any way to ask JUnit to *only* run tests
with a certain annotation, so that we could ask it to only run @Monster
tests (or some other annotation like @Weekly)?

Thanks,
Shawn


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: 2B tests

Posted by Michael McCandless <lu...@mikemccandless.com>.
The 2B tests are tests that confirm that Lucene's "limits" are working
correctly, e.g. 2B docs, huge FSTs, many terms, many postings, etc.

They are very slow to run and very heap-consuming so we don't run them
by default when you run "ant test".

Look for the @Monster annotation to see all of them...

Mike McCandless

http://blog.mikemccandless.com


On Sun, Mar 15, 2015 at 11:42 PM, Michael Wechner
<mi...@wyona.com> wrote:
> what are the "2B tests"? I guess the entry point is
>
> lucene/core/src/test/org/apache/lucene/index/Test2BTerms.java
>
> or where would you start to learn more about these tests?
>
> Thanks
>
> Michael
>
>
> Am 15.03.15 um 21:58 schrieb Michael McCandless:
>> I confirmed 2B tests are passing on 4.10.x.  Took 17 hours to run ...
>> this is the command I run, for future reference:
>>
>>   ant test -Dtests.monster=true -Dtests.heapsize=30g -Dtests.jvms=1
>> -Dtests.workDir=/p/tmp
>>
>> Mike McCandless
>>
>> http://blog.mikemccandless.com
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: 2B tests

Posted by Michael Wechner <mi...@wyona.com>.
what are the "2B tests"? I guess the entry point is

lucene/core/src/test/org/apache/lucene/index/Test2BTerms.java

or where would you start to learn more about these tests?

Thanks

Michael


Am 15.03.15 um 21:58 schrieb Michael McCandless:
> I confirmed 2B tests are passing on 4.10.x.  Took 17 hours to run ...
> this is the command I run, for future reference:
>
>   ant test -Dtests.monster=true -Dtests.heapsize=30g -Dtests.jvms=1
> -Dtests.workDir=/p/tmp
>
> Mike McCandless
>
> http://blog.mikemccandless.com
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: 2B tests

Posted by Shawn Heisey <ap...@elyograg.org>.
On 3/15/2015 2:58 PM, Michael McCandless wrote:
> I confirmed 2B tests are passing on 4.10.x.  Took 17 hours to run ...
> this is the command I run, for future reference:
> 
>   ant test -Dtests.monster=true -Dtests.heapsize=30g -Dtests.jvms=1
> -Dtests.workDir=/p/tmp

Thanks for your help on LUCENE-6002.  I would probably be still
scratching my head without your assistance.  The changes I made could
still be probably be improved, especially the comments in junit annotations.

Shawn


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org