You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Li Li <fa...@gmail.com> on 2010/11/08 04:59:58 UTC
lucene 4.0 release date
hi all,
When will lucene 4.0 be released?
I want to replace VInt compression with fast ones such as
PForDelta. In my application, decompressing a docList of 10M will use
about 300ms. In "Performance of Compressed Inverted List Caching in
Search Engines. With J. Zhang and X.Long. 17th International World
Wide Web Conference (WWW), April 2008." , the author says PForDelta is
much faster than VInt. And I also found a java implementation in
http://code.google.com/p/integer-array-compress-kit/ it's speed is 500
(M int / sec). But to achieve, I have to modify index file format. And
I found http://wiki.apache.org/lucene-java/FlexibleIndexing in lucene
4.0, it will support fore flexible index format. I want to know when
it will be released so as to decide whether wait it or doing it
myself. Thank you.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
RE: lucene 4.0 release date
Posted by Uwe Schindler <uw...@thetaphi.de>.
Apache Lucene and Apache Solr merged to one checkout at:
http://svn.apache.org/repos/asf/lucene/dev/
The combined version now share the same version numbers:
Lucene 3.x:
- http://svn.apache.org/repos/asf/lucene/dev/branches/branch3.x
Lucene trunk:
- http://svn.apache.org/repos/asf/lucene/dev/trunk
-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de
> -----Original Message-----
> From: Li Li [mailto:fancyerii@gmail.com]
> Sent: Monday, November 08, 2010 9:19 AM
> To: dev@lucene.apache.org
> Subject: Re: lucene 4.0 release date
>
> question about svn structure of lucene
> I visit http://svn.apache.org/repos/asf/lucene/
> it contains many things
> ..
> .htaccess
> board-reports/
> dev/
> java/
> lucene.net/
> mahout/
> openrelevance/
> pylucene/
> sandbox/
> site/
> solr/
>
> I just want to use lucene/java + solr. what directories should I check
out?
> it seems http://svn.apache.org/repos/asf/lucene/dev/ is current developed
> version http://svn.apache.org/repos/asf/lucene/java/ is old version before
3.0
> So I just need http://svn.apache.org/repos/asf/lucene/dev/ and
> https://svn.apache.org/repos/asf/lucene/dev/?
>
> 2010/11/8 Li Li <fa...@gmail.com>:
> > thank you.
> >
> > 2010/11/8 Uwe Schindler <uw...@thetaphi.de>:
> >> You have to also use Solr 4.0 :-)
> >>
> >> -----
> >> Uwe Schindler
> >> H.-H.-Meier-Allee 63, D-28213 Bremen
> >> http://www.thetaphi.de
> >> eMail: uwe@thetaphi.de
> >>
> >>
> >>> -----Original Message-----
> >>> From: Li Li [mailto:fancyerii@gmail.com]
> >>> Sent: Monday, November 08, 2010 8:47 AM
> >>> To: dev@lucene.apache.org; simon.willnauer@gmail.com
> >>> Subject: Re: lucene 4.0 release date
> >>>
> >>> thank you.
> >>> so if I want to use new compress/decompress algorithm, I must
> >>> use
> >> lucene
> >>> 4.0 in svn? Is there any patch for old release such as 2.9?because I
> >>> need
> >> solr 1.4
> >>> which based on lucene 2.9
> >>>
> >>> 2010/11/8 Simon Willnauer <si...@googlemail.com>:
> >>> > Li Li,
> >>> >
> >>> > there is no official / unofficial release date for lucene 4.0 if
> >>> > you want to use the latest and greatest features you need to
> >>> > checkout trunk of use a nightly build. My guess would be that
> >>> > there is at least
> >>> > 6 to 8 month to the next release but I can be wrong (more likely
> >>> > it might take even longer) .
> >>> >
> >>> > For PFoR etc you should look into:
> >>> > https://issues.apache.org/jira/browse/LUCENE-1410
> >>> > https://issues.apache.org/jira/browse/LUCENE-2723
> >>> >
> >>> > to get started - and read mikes blog
> >>> > http://chbits.blogspot.com/2010/08/lucene-performance-with-pfordel
> >>> > ta-c
> >>> > odec.html
> >>> >
> >>> > There is also S9
> >>> > https://issues.apache.org/jira/browse/LUCENE-2189
> >>> > and GroupVInt impls
> >>> > https://issues.apache.org/jira/browse/LUCENE-2735
> >>> >
> >>> > simon
> >>> >
> >>> > On Mon, Nov 8, 2010 at 4:59 AM, Li Li <fa...@gmail.com> wrote:
> >>> >> hi all,
> >>> >> When will lucene 4.0 be released?
> >>> >> I want to replace VInt compression with fast ones such as
> >>> >> PForDelta. In my application, decompressing a docList of 10M will
> >>> >> use about 300ms. In "Performance of Compressed Inverted List
> >>> >> Caching in Search Engines. With J. Zhang and X.Long. 17th
> >>> >> International World Wide Web Conference (WWW), April 2008." , the
> >>> >> author says PForDelta is much faster than VInt. And I also found
> >>> >> a java implementation in
> >>> >> http://code.google.com/p/integer-array-compress-kit/ it's speed
> >>> >> is
> >>> >> 500 (M int / sec). But to achieve, I have to modify index file
> >>> >> format. And I found
> >>> >> http://wiki.apache.org/lucene-java/FlexibleIndexing in lucene
> >>> >> 4.0, it will support fore flexible index format. I want to know
> >>> >> when it will be released so as to decide whether wait it or doing
it
> myself.
> >> Thank
> >>> you.
> >>> >>
> >>> >> -----------------------------------------------------------------
> >>> >> ---- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> >>> >> For additional commands, e-mail: dev-help@lucene.apache.org
> >>> >>
> >>> >>
> >>> >
> >>> > ------------------------------------------------------------------
> >>> > --- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For
> >>> > additional commands, e-mail: dev-help@lucene.apache.org
> >>> >
> >>> >
> >>>
> >>> --------------------------------------------------------------------
> >>> - To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For
> >>> additional commands, e-mail: dev-help@lucene.apache.org
> >>
> >>
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For
> >> additional commands, e-mail: dev-help@lucene.apache.org
> >>
> >>
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional
> commands, e-mail: dev-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: lucene 4.0 release date
Posted by Li Li <fa...@gmail.com>.
question about svn structure of lucene
I visit http://svn.apache.org/repos/asf/lucene/
it contains many things
..
.htaccess
board-reports/
dev/
java/
lucene.net/
mahout/
openrelevance/
pylucene/
sandbox/
site/
solr/
I just want to use lucene/java + solr. what directories should I check out?
it seems http://svn.apache.org/repos/asf/lucene/dev/ is current
developed version
http://svn.apache.org/repos/asf/lucene/java/ is old version before 3.0
So I just need http://svn.apache.org/repos/asf/lucene/dev/ and
https://svn.apache.org/repos/asf/lucene/dev/?
2010/11/8 Li Li <fa...@gmail.com>:
> thank you.
>
> 2010/11/8 Uwe Schindler <uw...@thetaphi.de>:
>> You have to also use Solr 4.0 :-)
>>
>> -----
>> Uwe Schindler
>> H.-H.-Meier-Allee 63, D-28213 Bremen
>> http://www.thetaphi.de
>> eMail: uwe@thetaphi.de
>>
>>
>>> -----Original Message-----
>>> From: Li Li [mailto:fancyerii@gmail.com]
>>> Sent: Monday, November 08, 2010 8:47 AM
>>> To: dev@lucene.apache.org; simon.willnauer@gmail.com
>>> Subject: Re: lucene 4.0 release date
>>>
>>> thank you.
>>> so if I want to use new compress/decompress algorithm, I must use
>> lucene
>>> 4.0 in svn? Is there any patch for old release such as 2.9?because I need
>> solr 1.4
>>> which based on lucene 2.9
>>>
>>> 2010/11/8 Simon Willnauer <si...@googlemail.com>:
>>> > Li Li,
>>> >
>>> > there is no official / unofficial release date for lucene 4.0 if you
>>> > want to use the latest and greatest features you need to checkout
>>> > trunk of use a nightly build. My guess would be that there is at least
>>> > 6 to 8 month to the next release but I can be wrong (more likely it
>>> > might take even longer) .
>>> >
>>> > For PFoR etc you should look into:
>>> > https://issues.apache.org/jira/browse/LUCENE-1410
>>> > https://issues.apache.org/jira/browse/LUCENE-2723
>>> >
>>> > to get started - and read mikes blog
>>> > http://chbits.blogspot.com/2010/08/lucene-performance-with-pfordelta-c
>>> > odec.html
>>> >
>>> > There is also S9
>>> > https://issues.apache.org/jira/browse/LUCENE-2189
>>> > and GroupVInt impls
>>> > https://issues.apache.org/jira/browse/LUCENE-2735
>>> >
>>> > simon
>>> >
>>> > On Mon, Nov 8, 2010 at 4:59 AM, Li Li <fa...@gmail.com> wrote:
>>> >> hi all,
>>> >> When will lucene 4.0 be released?
>>> >> I want to replace VInt compression with fast ones such as
>>> >> PForDelta. In my application, decompressing a docList of 10M will use
>>> >> about 300ms. In "Performance of Compressed Inverted List Caching in
>>> >> Search Engines. With J. Zhang and X.Long. 17th International World
>>> >> Wide Web Conference (WWW), April 2008." , the author says PForDelta
>>> >> is much faster than VInt. And I also found a java implementation in
>>> >> http://code.google.com/p/integer-array-compress-kit/ it's speed is
>>> >> 500 (M int / sec). But to achieve, I have to modify index file
>>> >> format. And I found
>>> >> http://wiki.apache.org/lucene-java/FlexibleIndexing in lucene 4.0,
>>> >> it will support fore flexible index format. I want to know when it
>>> >> will be released so as to decide whether wait it or doing it myself.
>> Thank
>>> you.
>>> >>
>>> >> ---------------------------------------------------------------------
>>> >> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For
>>> >> additional commands, e-mail: dev-help@lucene.apache.org
>>> >>
>>> >>
>>> >
>>> > ---------------------------------------------------------------------
>>> > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For
>>> > additional commands, e-mail: dev-help@lucene.apache.org
>>> >
>>> >
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional
>>> commands, e-mail: dev-help@lucene.apache.org
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: lucene 4.0 release date
Posted by Li Li <fa...@gmail.com>.
thank you.
2010/11/8 Uwe Schindler <uw...@thetaphi.de>:
> You have to also use Solr 4.0 :-)
>
> -----
> Uwe Schindler
> H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: uwe@thetaphi.de
>
>
>> -----Original Message-----
>> From: Li Li [mailto:fancyerii@gmail.com]
>> Sent: Monday, November 08, 2010 8:47 AM
>> To: dev@lucene.apache.org; simon.willnauer@gmail.com
>> Subject: Re: lucene 4.0 release date
>>
>> thank you.
>> so if I want to use new compress/decompress algorithm, I must use
> lucene
>> 4.0 in svn? Is there any patch for old release such as 2.9?because I need
> solr 1.4
>> which based on lucene 2.9
>>
>> 2010/11/8 Simon Willnauer <si...@googlemail.com>:
>> > Li Li,
>> >
>> > there is no official / unofficial release date for lucene 4.0 if you
>> > want to use the latest and greatest features you need to checkout
>> > trunk of use a nightly build. My guess would be that there is at least
>> > 6 to 8 month to the next release but I can be wrong (more likely it
>> > might take even longer) .
>> >
>> > For PFoR etc you should look into:
>> > https://issues.apache.org/jira/browse/LUCENE-1410
>> > https://issues.apache.org/jira/browse/LUCENE-2723
>> >
>> > to get started - and read mikes blog
>> > http://chbits.blogspot.com/2010/08/lucene-performance-with-pfordelta-c
>> > odec.html
>> >
>> > There is also S9
>> > https://issues.apache.org/jira/browse/LUCENE-2189
>> > and GroupVInt impls
>> > https://issues.apache.org/jira/browse/LUCENE-2735
>> >
>> > simon
>> >
>> > On Mon, Nov 8, 2010 at 4:59 AM, Li Li <fa...@gmail.com> wrote:
>> >> hi all,
>> >> When will lucene 4.0 be released?
>> >> I want to replace VInt compression with fast ones such as
>> >> PForDelta. In my application, decompressing a docList of 10M will use
>> >> about 300ms. In "Performance of Compressed Inverted List Caching in
>> >> Search Engines. With J. Zhang and X.Long. 17th International World
>> >> Wide Web Conference (WWW), April 2008." , the author says PForDelta
>> >> is much faster than VInt. And I also found a java implementation in
>> >> http://code.google.com/p/integer-array-compress-kit/ it's speed is
>> >> 500 (M int / sec). But to achieve, I have to modify index file
>> >> format. And I found
>> >> http://wiki.apache.org/lucene-java/FlexibleIndexing in lucene 4.0,
>> >> it will support fore flexible index format. I want to know when it
>> >> will be released so as to decide whether wait it or doing it myself.
> Thank
>> you.
>> >>
>> >> ---------------------------------------------------------------------
>> >> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For
>> >> additional commands, e-mail: dev-help@lucene.apache.org
>> >>
>> >>
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For
>> > additional commands, e-mail: dev-help@lucene.apache.org
>> >
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional
>> commands, e-mail: dev-help@lucene.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
RE: lucene 4.0 release date
Posted by Uwe Schindler <uw...@thetaphi.de>.
You have to also use Solr 4.0 :-)
-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de
> -----Original Message-----
> From: Li Li [mailto:fancyerii@gmail.com]
> Sent: Monday, November 08, 2010 8:47 AM
> To: dev@lucene.apache.org; simon.willnauer@gmail.com
> Subject: Re: lucene 4.0 release date
>
> thank you.
> so if I want to use new compress/decompress algorithm, I must use
lucene
> 4.0 in svn? Is there any patch for old release such as 2.9?because I need
solr 1.4
> which based on lucene 2.9
>
> 2010/11/8 Simon Willnauer <si...@googlemail.com>:
> > Li Li,
> >
> > there is no official / unofficial release date for lucene 4.0 if you
> > want to use the latest and greatest features you need to checkout
> > trunk of use a nightly build. My guess would be that there is at least
> > 6 to 8 month to the next release but I can be wrong (more likely it
> > might take even longer) .
> >
> > For PFoR etc you should look into:
> > https://issues.apache.org/jira/browse/LUCENE-1410
> > https://issues.apache.org/jira/browse/LUCENE-2723
> >
> > to get started - and read mikes blog
> > http://chbits.blogspot.com/2010/08/lucene-performance-with-pfordelta-c
> > odec.html
> >
> > There is also S9
> > https://issues.apache.org/jira/browse/LUCENE-2189
> > and GroupVInt impls
> > https://issues.apache.org/jira/browse/LUCENE-2735
> >
> > simon
> >
> > On Mon, Nov 8, 2010 at 4:59 AM, Li Li <fa...@gmail.com> wrote:
> >> hi all,
> >> When will lucene 4.0 be released?
> >> I want to replace VInt compression with fast ones such as
> >> PForDelta. In my application, decompressing a docList of 10M will use
> >> about 300ms. In "Performance of Compressed Inverted List Caching in
> >> Search Engines. With J. Zhang and X.Long. 17th International World
> >> Wide Web Conference (WWW), April 2008." , the author says PForDelta
> >> is much faster than VInt. And I also found a java implementation in
> >> http://code.google.com/p/integer-array-compress-kit/ it's speed is
> >> 500 (M int / sec). But to achieve, I have to modify index file
> >> format. And I found
> >> http://wiki.apache.org/lucene-java/FlexibleIndexing in lucene 4.0,
> >> it will support fore flexible index format. I want to know when it
> >> will be released so as to decide whether wait it or doing it myself.
Thank
> you.
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For
> >> additional commands, e-mail: dev-help@lucene.apache.org
> >>
> >>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For
> > additional commands, e-mail: dev-help@lucene.apache.org
> >
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional
> commands, e-mail: dev-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: lucene 4.0 release date
Posted by Li Li <fa...@gmail.com>.
thank you.
so if I want to use new compress/decompress algorithm, I must use
lucene 4.0 in svn? Is there any patch for old release such as
2.9?because I need solr 1.4 which based on lucene 2.9
2010/11/8 Simon Willnauer <si...@googlemail.com>:
> Li Li,
>
> there is no official / unofficial release date for lucene 4.0 if you
> want to use the latest and greatest features you need to checkout
> trunk of use a nightly build. My guess would be that there is at least
> 6 to 8 month to the next release but I can be wrong (more likely it
> might take even longer) .
>
> For PFoR etc you should look into:
> https://issues.apache.org/jira/browse/LUCENE-1410
> https://issues.apache.org/jira/browse/LUCENE-2723
>
> to get started - and read mikes blog
> http://chbits.blogspot.com/2010/08/lucene-performance-with-pfordelta-codec.html
>
> There is also S9
> https://issues.apache.org/jira/browse/LUCENE-2189
> and GroupVInt impls
> https://issues.apache.org/jira/browse/LUCENE-2735
>
> simon
>
> On Mon, Nov 8, 2010 at 4:59 AM, Li Li <fa...@gmail.com> wrote:
>> hi all,
>> When will lucene 4.0 be released?
>> I want to replace VInt compression with fast ones such as
>> PForDelta. In my application, decompressing a docList of 10M will use
>> about 300ms. In "Performance of Compressed Inverted List Caching in
>> Search Engines. With J. Zhang and X.Long. 17th International World
>> Wide Web Conference (WWW), April 2008." , the author says PForDelta is
>> much faster than VInt. And I also found a java implementation in
>> http://code.google.com/p/integer-array-compress-kit/ it's speed is 500
>> (M int / sec). But to achieve, I have to modify index file format. And
>> I found http://wiki.apache.org/lucene-java/FlexibleIndexing in lucene
>> 4.0, it will support fore flexible index format. I want to know when
>> it will be released so as to decide whether wait it or doing it
>> myself. Thank you.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: lucene 4.0 release date
Posted by Simon Willnauer <si...@googlemail.com>.
Li Li,
there is no official / unofficial release date for lucene 4.0 if you
want to use the latest and greatest features you need to checkout
trunk of use a nightly build. My guess would be that there is at least
6 to 8 month to the next release but I can be wrong (more likely it
might take even longer) .
For PFoR etc you should look into:
https://issues.apache.org/jira/browse/LUCENE-1410
https://issues.apache.org/jira/browse/LUCENE-2723
to get started - and read mikes blog
http://chbits.blogspot.com/2010/08/lucene-performance-with-pfordelta-codec.html
There is also S9
https://issues.apache.org/jira/browse/LUCENE-2189
and GroupVInt impls
https://issues.apache.org/jira/browse/LUCENE-2735
simon
On Mon, Nov 8, 2010 at 4:59 AM, Li Li <fa...@gmail.com> wrote:
> hi all,
> When will lucene 4.0 be released?
> I want to replace VInt compression with fast ones such as
> PForDelta. In my application, decompressing a docList of 10M will use
> about 300ms. In "Performance of Compressed Inverted List Caching in
> Search Engines. With J. Zhang and X.Long. 17th International World
> Wide Web Conference (WWW), April 2008." , the author says PForDelta is
> much faster than VInt. And I also found a java implementation in
> http://code.google.com/p/integer-array-compress-kit/ it's speed is 500
> (M int / sec). But to achieve, I have to modify index file format. And
> I found http://wiki.apache.org/lucene-java/FlexibleIndexing in lucene
> 4.0, it will support fore flexible index format. I want to know when
> it will be released so as to decide whether wait it or doing it
> myself. Thank you.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org