You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by Robert Muir <rc...@gmail.com> on 2010/01/22 14:16:39 UTC
Re: Applying LUCENE-1606 -- which version
the patch won't especially help queries like this. maybe they will be
5 or 6 times faster, but still slow.
if you really want to do such queries, consider this: do you really
need * to match an INFINITE amount of characters?!?!
If not, then consider rewriting input queries like this into FINITE
RegExpQuerys, something like .{0,3}poker.* at least, where the first
component can only match at most 3 of any character, before it must be
a p.
you can tweak the 'parameter' 3 until its a reasonable tradeoff
between relevance and performance.
if, on the other hand, you have 100 million rows and feel its
mandatory that * matches an infinite amount of characters in this
case, then I recommend storing your data in a different structure that
will support such queries.
On Fri, Jan 22, 2010 at 5:46 AM, Sriram Muthuswamy Chittathoor
<sr...@ivycomptech.com> wrote:
> Thanks for the fast reply.
> http://svn.apache.org/repos/asf/lucene/java/branches/flex_1458/
> I used the one above to checkout. Hope it is fine. Will see how it
> works out.
>
> My requirement is that I have a index into a DB row (100 million rows).
> On some text fields I want to do contains search fast. I hope this
> will suit my needs. Something like screenName:*poker*
>
>
>
> -----Original Message-----
> From: Uwe Schindler [mailto:uwe@thetaphi.de]
> Sent: Friday, January 22, 2010 4:00 PM
> To: java-user@lucene.apache.org
> Subject: RE: Applying LUCENE-1606 -- which version
>
> Hi Sriram,
>
> This patch cannot be applied to 3.0 as it depends on a new Lucene branch
> called flex. It depends on features, only added in version 3.1. So it
> does not even apply on trunk, you have to checkout the experimental flex
> branch first.
>
> For 3.0 you, may try one of the early patches (the last without -flex in
> name) in this issue, but they will never go into lucene 3.1, instead the
> flex branch will hopefully merge with trunk, soon. Also the non-flex
> patches are not so performant, because the performance increases only
> with flexible indexing API.
>
> Uwe
>
> -----
> Uwe Schindler
> H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: uwe@thetaphi.de
>
>> -----Original Message-----
>> From: Sriram Muthuswamy Chittathoor [mailto:sriramc@ivycomptech.com]
>> Sent: Friday, January 22, 2010 11:05 AM
>> To: java-user@lucene.apache.org
>> Subject: Applying LUCENE-1606 -- which version
>>
>> Hi:
>>
>>
>>
>> I am trying to apply this Automata patch on my Lucene 3.0 src code but
>> running into issues as it is complaining about failures to apply patch
>> to certain files. Is this the right version
>>
>> To apply to. Please help
>>
>>
>>
>> Thanks
>>
>>
>>
>> Sriram C
>>
>>
>>
>> LUCENE-1606
>> https://issues.apache.org/jira/browse/LUCENE-1606
>>
>>
>> This email is sent for and on behalf of Ivy Comptech Private Limited.
>> Ivy Comptech Private Limited is a limited liability company.
>>
>> This email and any attachments are confidential, and may be legally
>> privileged and protected by copyright. If you are not the intended
>> recipient dissemination or copying of this email is prohibited. If you
>> have received this in error, please notify the sender by replying by
>> email and then delete the email completely from your system.
>> Any views or opinions are solely those of the sender. This
>> communication is not intended to form a binding contract on behalf of
>> Ivy Comptech Private Limited unless expressly indicated to the
> contrary
>> and properly authorised. Any actions taken on the basis of this email
>> are at the recipient's own risk.
>>
>> Registered office:
>> Ivy Comptech Private Limited, Cyber Spazio, Road No. 2, Banjara Hills,
>> Hyderabad 500 033, Andhra Pradesh, India. Registered number: 37994.
>> Registered in India. A list of members' names is available for
>> inspection at the registered office.
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
--
Robert Muir
rcmuir@gmail.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: Applying LUCENE-1606 -- which version
Posted by Robert Muir <rc...@gmail.com>.
what is a 'contains clause' ??? what is the use case behind it, and
why can't poker be tokenized from the text so they just type 'poker'
with no wildcards?
On Fri, Jan 22, 2010 at 8:41 AM, Sriram Muthuswamy Chittathoor
<sr...@ivycomptech.com> wrote:
> Okay the only reason I asked was to support contains clause. But it could be relaxed if it is causing a issue and we could support those .{0,3}poker.* fast.
>
>
>
> -----Original Message-----
> From: Robert Muir [mailto:rcmuir@gmail.com]
> Sent: Friday, January 22, 2010 7:01 PM
> To: java-user@lucene.apache.org
> Subject: Re: Applying LUCENE-1606 -- which version
>
> the first step if determining why you really need to support *poker*
> on 100M database rows, is it some programmers fault, or are users
> directly typing this in?
>
> Either can probably re-trained, perhaps you should do like google, and
> drop these characters from users queries if they do this...
>
> On Fri, Jan 22, 2010 at 8:28 AM, Sriram Muthuswamy Chittathoor
> <sr...@ivycomptech.com> wrote:
>> then I recommend storing your data in a different structure that
>> will support such queries.
>> -- what would this structure be ? Is this to be done through Lucene.
>>
>> -----Original Message-----
>> From: Robert Muir [mailto:rcmuir@gmail.com]
>> Sent: Friday, January 22, 2010 6:47 PM
>> To: java-user@lucene.apache.org
>> Subject: Re: Applying LUCENE-1606 -- which version
>>
>> the patch won't especially help queries like this. maybe they will be
>> 5 or 6 times faster, but still slow.
>>
>> if you really want to do such queries, consider this: do you really
>> need * to match an INFINITE amount of characters?!?!
>>
>> If not, then consider rewriting input queries like this into FINITE
>> RegExpQuerys, something like .{0,3}poker.* at least, where the first
>> component can only match at most 3 of any character, before it must be
>> a p.
>> you can tweak the 'parameter' 3 until its a reasonable tradeoff
>> between relevance and performance.
>>
>> if, on the other hand, you have 100 million rows and feel its
>> mandatory that * matches an infinite amount of characters in this
>> case, then I recommend storing your data in a different structure that
>> will support such queries.
>>
>> On Fri, Jan 22, 2010 at 5:46 AM, Sriram Muthuswamy Chittathoor
>> <sr...@ivycomptech.com> wrote:
>>> Thanks for the fast reply.
>>> http://svn.apache.org/repos/asf/lucene/java/branches/flex_1458/
>>> I used the one above to checkout. Hope it is fine. Will see how it
>>> works out.
>>>
>>> My requirement is that I have a index into a DB row (100 million rows).
>>> On some text fields I want to do contains search fast. I hope this
>>> will suit my needs. Something like screenName:*poker*
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: Uwe Schindler [mailto:uwe@thetaphi.de]
>>> Sent: Friday, January 22, 2010 4:00 PM
>>> To: java-user@lucene.apache.org
>>> Subject: RE: Applying LUCENE-1606 -- which version
>>>
>>> Hi Sriram,
>>>
>>> This patch cannot be applied to 3.0 as it depends on a new Lucene branch
>>> called flex. It depends on features, only added in version 3.1. So it
>>> does not even apply on trunk, you have to checkout the experimental flex
>>> branch first.
>>>
>>> For 3.0 you, may try one of the early patches (the last without -flex in
>>> name) in this issue, but they will never go into lucene 3.1, instead the
>>> flex branch will hopefully merge with trunk, soon. Also the non-flex
>>> patches are not so performant, because the performance increases only
>>> with flexible indexing API.
>>>
>>> Uwe
>>>
>>> -----
>>> Uwe Schindler
>>> H.-H.-Meier-Allee 63, D-28213 Bremen
>>> http://www.thetaphi.de
>>> eMail: uwe@thetaphi.de
>>>
>>>> -----Original Message-----
>>>> From: Sriram Muthuswamy Chittathoor [mailto:sriramc@ivycomptech.com]
>>>> Sent: Friday, January 22, 2010 11:05 AM
>>>> To: java-user@lucene.apache.org
>>>> Subject: Applying LUCENE-1606 -- which version
>>>>
>>>> Hi:
>>>>
>>>>
>>>>
>>>> I am trying to apply this Automata patch on my Lucene 3.0 src code but
>>>> running into issues as it is complaining about failures to apply patch
>>>> to certain files. Is this the right version
>>>>
>>>> To apply to. Please help
>>>>
>>>>
>>>>
>>>> Thanks
>>>>
>>>>
>>>>
>>>> Sriram C
>>>>
>>>>
>>>>
>>>> LUCENE-1606
>>>> https://issues.apache.org/jira/browse/LUCENE-1606
>>>>
>>>>
>>>> This email is sent for and on behalf of Ivy Comptech Private Limited.
>>>> Ivy Comptech Private Limited is a limited liability company.
>>>>
>>>> This email and any attachments are confidential, and may be legally
>>>> privileged and protected by copyright. If you are not the intended
>>>> recipient dissemination or copying of this email is prohibited. If you
>>>> have received this in error, please notify the sender by replying by
>>>> email and then delete the email completely from your system.
>>>> Any views or opinions are solely those of the sender. This
>>>> communication is not intended to form a binding contract on behalf of
>>>> Ivy Comptech Private Limited unless expressly indicated to the
>>> contrary
>>>> and properly authorised. Any actions taken on the basis of this email
>>>> are at the recipient's own risk.
>>>>
>>>> Registered office:
>>>> Ivy Comptech Private Limited, Cyber Spazio, Road No. 2, Banjara Hills,
>>>> Hyderabad 500 033, Andhra Pradesh, India. Registered number: 37994.
>>>> Registered in India. A list of members' names is available for
>>>> inspection at the registered office.
>>>
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>
>>>
>>
>>
>>
>> --
>> Robert Muir
>> rcmuir@gmail.com
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>> This email is sent for and on behalf of Ivy Comptech Private Limited. Ivy Comptech Private Limited is a limited liability company.
>>
>> This email and any attachments are confidential, and may be legally privileged and protected by copyright. If you are not the intended recipient dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system.
>> Any views or opinions are solely those of the sender. This communication is not intended to form a binding contract on behalf of Ivy Comptech Private Limited unless expressly indicated to the contrary and properly authorised. Any actions taken on the basis of this email are at the recipient's own risk.
>>
>> Registered office:
>> Ivy Comptech Private Limited, Cyber Spazio, Road No. 2, Banjara Hills, Hyderabad 500 033, Andhra Pradesh, India. Registered number: 37994. Registered in India. A list of members' names is available for inspection at the registered office.
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>
>
>
> --
> Robert Muir
> rcmuir@gmail.com
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
--
Robert Muir
rcmuir@gmail.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
RE: Applying LUCENE-1606 -- which version
Posted by Sriram Muthuswamy Chittathoor <sr...@ivycomptech.com>.
Okay the only reason I asked was to support contains clause. But it could be relaxed if it is causing a issue and we could support those .{0,3}poker.* fast.
-----Original Message-----
From: Robert Muir [mailto:rcmuir@gmail.com]
Sent: Friday, January 22, 2010 7:01 PM
To: java-user@lucene.apache.org
Subject: Re: Applying LUCENE-1606 -- which version
the first step if determining why you really need to support *poker*
on 100M database rows, is it some programmers fault, or are users
directly typing this in?
Either can probably re-trained, perhaps you should do like google, and
drop these characters from users queries if they do this...
On Fri, Jan 22, 2010 at 8:28 AM, Sriram Muthuswamy Chittathoor
<sr...@ivycomptech.com> wrote:
> then I recommend storing your data in a different structure that
> will support such queries.
> -- what would this structure be ? Is this to be done through Lucene.
>
> -----Original Message-----
> From: Robert Muir [mailto:rcmuir@gmail.com]
> Sent: Friday, January 22, 2010 6:47 PM
> To: java-user@lucene.apache.org
> Subject: Re: Applying LUCENE-1606 -- which version
>
> the patch won't especially help queries like this. maybe they will be
> 5 or 6 times faster, but still slow.
>
> if you really want to do such queries, consider this: do you really
> need * to match an INFINITE amount of characters?!?!
>
> If not, then consider rewriting input queries like this into FINITE
> RegExpQuerys, something like .{0,3}poker.* at least, where the first
> component can only match at most 3 of any character, before it must be
> a p.
> you can tweak the 'parameter' 3 until its a reasonable tradeoff
> between relevance and performance.
>
> if, on the other hand, you have 100 million rows and feel its
> mandatory that * matches an infinite amount of characters in this
> case, then I recommend storing your data in a different structure that
> will support such queries.
>
> On Fri, Jan 22, 2010 at 5:46 AM, Sriram Muthuswamy Chittathoor
> <sr...@ivycomptech.com> wrote:
>> Thanks for the fast reply.
>> http://svn.apache.org/repos/asf/lucene/java/branches/flex_1458/
>> I used the one above to checkout. Hope it is fine. Will see how it
>> works out.
>>
>> My requirement is that I have a index into a DB row (100 million rows).
>> On some text fields I want to do contains search fast. I hope this
>> will suit my needs. Something like screenName:*poker*
>>
>>
>>
>> -----Original Message-----
>> From: Uwe Schindler [mailto:uwe@thetaphi.de]
>> Sent: Friday, January 22, 2010 4:00 PM
>> To: java-user@lucene.apache.org
>> Subject: RE: Applying LUCENE-1606 -- which version
>>
>> Hi Sriram,
>>
>> This patch cannot be applied to 3.0 as it depends on a new Lucene branch
>> called flex. It depends on features, only added in version 3.1. So it
>> does not even apply on trunk, you have to checkout the experimental flex
>> branch first.
>>
>> For 3.0 you, may try one of the early patches (the last without -flex in
>> name) in this issue, but they will never go into lucene 3.1, instead the
>> flex branch will hopefully merge with trunk, soon. Also the non-flex
>> patches are not so performant, because the performance increases only
>> with flexible indexing API.
>>
>> Uwe
>>
>> -----
>> Uwe Schindler
>> H.-H.-Meier-Allee 63, D-28213 Bremen
>> http://www.thetaphi.de
>> eMail: uwe@thetaphi.de
>>
>>> -----Original Message-----
>>> From: Sriram Muthuswamy Chittathoor [mailto:sriramc@ivycomptech.com]
>>> Sent: Friday, January 22, 2010 11:05 AM
>>> To: java-user@lucene.apache.org
>>> Subject: Applying LUCENE-1606 -- which version
>>>
>>> Hi:
>>>
>>>
>>>
>>> I am trying to apply this Automata patch on my Lucene 3.0 src code but
>>> running into issues as it is complaining about failures to apply patch
>>> to certain files. Is this the right version
>>>
>>> To apply to. Please help
>>>
>>>
>>>
>>> Thanks
>>>
>>>
>>>
>>> Sriram C
>>>
>>>
>>>
>>> LUCENE-1606
>>> https://issues.apache.org/jira/browse/LUCENE-1606
>>>
>>>
>>> This email is sent for and on behalf of Ivy Comptech Private Limited.
>>> Ivy Comptech Private Limited is a limited liability company.
>>>
>>> This email and any attachments are confidential, and may be legally
>>> privileged and protected by copyright. If you are not the intended
>>> recipient dissemination or copying of this email is prohibited. If you
>>> have received this in error, please notify the sender by replying by
>>> email and then delete the email completely from your system.
>>> Any views or opinions are solely those of the sender. This
>>> communication is not intended to form a binding contract on behalf of
>>> Ivy Comptech Private Limited unless expressly indicated to the
>> contrary
>>> and properly authorised. Any actions taken on the basis of this email
>>> are at the recipient's own risk.
>>>
>>> Registered office:
>>> Ivy Comptech Private Limited, Cyber Spazio, Road No. 2, Banjara Hills,
>>> Hyderabad 500 033, Andhra Pradesh, India. Registered number: 37994.
>>> Registered in India. A list of members' names is available for
>>> inspection at the registered office.
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>
>
>
> --
> Robert Muir
> rcmuir@gmail.com
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
> This email is sent for and on behalf of Ivy Comptech Private Limited. Ivy Comptech Private Limited is a limited liability company.
>
> This email and any attachments are confidential, and may be legally privileged and protected by copyright. If you are not the intended recipient dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system.
> Any views or opinions are solely those of the sender. This communication is not intended to form a binding contract on behalf of Ivy Comptech Private Limited unless expressly indicated to the contrary and properly authorised. Any actions taken on the basis of this email are at the recipient's own risk.
>
> Registered office:
> Ivy Comptech Private Limited, Cyber Spazio, Road No. 2, Banjara Hills, Hyderabad 500 033, Andhra Pradesh, India. Registered number: 37994. Registered in India. A list of members' names is available for inspection at the registered office.
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
--
Robert Muir
rcmuir@gmail.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: Applying LUCENE-1606 -- which version
Posted by Robert Muir <rc...@gmail.com>.
the first step if determining why you really need to support *poker*
on 100M database rows, is it some programmers fault, or are users
directly typing this in?
Either can probably re-trained, perhaps you should do like google, and
drop these characters from users queries if they do this...
On Fri, Jan 22, 2010 at 8:28 AM, Sriram Muthuswamy Chittathoor
<sr...@ivycomptech.com> wrote:
> then I recommend storing your data in a different structure that
> will support such queries.
> -- what would this structure be ? Is this to be done through Lucene.
>
> -----Original Message-----
> From: Robert Muir [mailto:rcmuir@gmail.com]
> Sent: Friday, January 22, 2010 6:47 PM
> To: java-user@lucene.apache.org
> Subject: Re: Applying LUCENE-1606 -- which version
>
> the patch won't especially help queries like this. maybe they will be
> 5 or 6 times faster, but still slow.
>
> if you really want to do such queries, consider this: do you really
> need * to match an INFINITE amount of characters?!?!
>
> If not, then consider rewriting input queries like this into FINITE
> RegExpQuerys, something like .{0,3}poker.* at least, where the first
> component can only match at most 3 of any character, before it must be
> a p.
> you can tweak the 'parameter' 3 until its a reasonable tradeoff
> between relevance and performance.
>
> if, on the other hand, you have 100 million rows and feel its
> mandatory that * matches an infinite amount of characters in this
> case, then I recommend storing your data in a different structure that
> will support such queries.
>
> On Fri, Jan 22, 2010 at 5:46 AM, Sriram Muthuswamy Chittathoor
> <sr...@ivycomptech.com> wrote:
>> Thanks for the fast reply.
>> http://svn.apache.org/repos/asf/lucene/java/branches/flex_1458/
>> I used the one above to checkout. Hope it is fine. Will see how it
>> works out.
>>
>> My requirement is that I have a index into a DB row (100 million rows).
>> On some text fields I want to do contains search fast. I hope this
>> will suit my needs. Something like screenName:*poker*
>>
>>
>>
>> -----Original Message-----
>> From: Uwe Schindler [mailto:uwe@thetaphi.de]
>> Sent: Friday, January 22, 2010 4:00 PM
>> To: java-user@lucene.apache.org
>> Subject: RE: Applying LUCENE-1606 -- which version
>>
>> Hi Sriram,
>>
>> This patch cannot be applied to 3.0 as it depends on a new Lucene branch
>> called flex. It depends on features, only added in version 3.1. So it
>> does not even apply on trunk, you have to checkout the experimental flex
>> branch first.
>>
>> For 3.0 you, may try one of the early patches (the last without -flex in
>> name) in this issue, but they will never go into lucene 3.1, instead the
>> flex branch will hopefully merge with trunk, soon. Also the non-flex
>> patches are not so performant, because the performance increases only
>> with flexible indexing API.
>>
>> Uwe
>>
>> -----
>> Uwe Schindler
>> H.-H.-Meier-Allee 63, D-28213 Bremen
>> http://www.thetaphi.de
>> eMail: uwe@thetaphi.de
>>
>>> -----Original Message-----
>>> From: Sriram Muthuswamy Chittathoor [mailto:sriramc@ivycomptech.com]
>>> Sent: Friday, January 22, 2010 11:05 AM
>>> To: java-user@lucene.apache.org
>>> Subject: Applying LUCENE-1606 -- which version
>>>
>>> Hi:
>>>
>>>
>>>
>>> I am trying to apply this Automata patch on my Lucene 3.0 src code but
>>> running into issues as it is complaining about failures to apply patch
>>> to certain files. Is this the right version
>>>
>>> To apply to. Please help
>>>
>>>
>>>
>>> Thanks
>>>
>>>
>>>
>>> Sriram C
>>>
>>>
>>>
>>> LUCENE-1606
>>> https://issues.apache.org/jira/browse/LUCENE-1606
>>>
>>>
>>> This email is sent for and on behalf of Ivy Comptech Private Limited.
>>> Ivy Comptech Private Limited is a limited liability company.
>>>
>>> This email and any attachments are confidential, and may be legally
>>> privileged and protected by copyright. If you are not the intended
>>> recipient dissemination or copying of this email is prohibited. If you
>>> have received this in error, please notify the sender by replying by
>>> email and then delete the email completely from your system.
>>> Any views or opinions are solely those of the sender. This
>>> communication is not intended to form a binding contract on behalf of
>>> Ivy Comptech Private Limited unless expressly indicated to the
>> contrary
>>> and properly authorised. Any actions taken on the basis of this email
>>> are at the recipient's own risk.
>>>
>>> Registered office:
>>> Ivy Comptech Private Limited, Cyber Spazio, Road No. 2, Banjara Hills,
>>> Hyderabad 500 033, Andhra Pradesh, India. Registered number: 37994.
>>> Registered in India. A list of members' names is available for
>>> inspection at the registered office.
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>
>
>
> --
> Robert Muir
> rcmuir@gmail.com
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
> This email is sent for and on behalf of Ivy Comptech Private Limited. Ivy Comptech Private Limited is a limited liability company.
>
> This email and any attachments are confidential, and may be legally privileged and protected by copyright. If you are not the intended recipient dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system.
> Any views or opinions are solely those of the sender. This communication is not intended to form a binding contract on behalf of Ivy Comptech Private Limited unless expressly indicated to the contrary and properly authorised. Any actions taken on the basis of this email are at the recipient's own risk.
>
> Registered office:
> Ivy Comptech Private Limited, Cyber Spazio, Road No. 2, Banjara Hills, Hyderabad 500 033, Andhra Pradesh, India. Registered number: 37994. Registered in India. A list of members' names is available for inspection at the registered office.
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
--
Robert Muir
rcmuir@gmail.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
RE: Applying LUCENE-1606 -- which version
Posted by Sriram Muthuswamy Chittathoor <sr...@ivycomptech.com>.
then I recommend storing your data in a different structure that
will support such queries.
-- what would this structure be ? Is this to be done through Lucene.
-----Original Message-----
From: Robert Muir [mailto:rcmuir@gmail.com]
Sent: Friday, January 22, 2010 6:47 PM
To: java-user@lucene.apache.org
Subject: Re: Applying LUCENE-1606 -- which version
the patch won't especially help queries like this. maybe they will be
5 or 6 times faster, but still slow.
if you really want to do such queries, consider this: do you really
need * to match an INFINITE amount of characters?!?!
If not, then consider rewriting input queries like this into FINITE
RegExpQuerys, something like .{0,3}poker.* at least, where the first
component can only match at most 3 of any character, before it must be
a p.
you can tweak the 'parameter' 3 until its a reasonable tradeoff
between relevance and performance.
if, on the other hand, you have 100 million rows and feel its
mandatory that * matches an infinite amount of characters in this
case, then I recommend storing your data in a different structure that
will support such queries.
On Fri, Jan 22, 2010 at 5:46 AM, Sriram Muthuswamy Chittathoor
<sr...@ivycomptech.com> wrote:
> Thanks for the fast reply.
> http://svn.apache.org/repos/asf/lucene/java/branches/flex_1458/
> I used the one above to checkout. Hope it is fine. Will see how it
> works out.
>
> My requirement is that I have a index into a DB row (100 million rows).
> On some text fields I want to do contains search fast. I hope this
> will suit my needs. Something like screenName:*poker*
>
>
>
> -----Original Message-----
> From: Uwe Schindler [mailto:uwe@thetaphi.de]
> Sent: Friday, January 22, 2010 4:00 PM
> To: java-user@lucene.apache.org
> Subject: RE: Applying LUCENE-1606 -- which version
>
> Hi Sriram,
>
> This patch cannot be applied to 3.0 as it depends on a new Lucene branch
> called flex. It depends on features, only added in version 3.1. So it
> does not even apply on trunk, you have to checkout the experimental flex
> branch first.
>
> For 3.0 you, may try one of the early patches (the last without -flex in
> name) in this issue, but they will never go into lucene 3.1, instead the
> flex branch will hopefully merge with trunk, soon. Also the non-flex
> patches are not so performant, because the performance increases only
> with flexible indexing API.
>
> Uwe
>
> -----
> Uwe Schindler
> H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: uwe@thetaphi.de
>
>> -----Original Message-----
>> From: Sriram Muthuswamy Chittathoor [mailto:sriramc@ivycomptech.com]
>> Sent: Friday, January 22, 2010 11:05 AM
>> To: java-user@lucene.apache.org
>> Subject: Applying LUCENE-1606 -- which version
>>
>> Hi:
>>
>>
>>
>> I am trying to apply this Automata patch on my Lucene 3.0 src code but
>> running into issues as it is complaining about failures to apply patch
>> to certain files. Is this the right version
>>
>> To apply to. Please help
>>
>>
>>
>> Thanks
>>
>>
>>
>> Sriram C
>>
>>
>>
>> LUCENE-1606
>> https://issues.apache.org/jira/browse/LUCENE-1606
>>
>>
>> This email is sent for and on behalf of Ivy Comptech Private Limited.
>> Ivy Comptech Private Limited is a limited liability company.
>>
>> This email and any attachments are confidential, and may be legally
>> privileged and protected by copyright. If you are not the intended
>> recipient dissemination or copying of this email is prohibited. If you
>> have received this in error, please notify the sender by replying by
>> email and then delete the email completely from your system.
>> Any views or opinions are solely those of the sender. This
>> communication is not intended to form a binding contract on behalf of
>> Ivy Comptech Private Limited unless expressly indicated to the
> contrary
>> and properly authorised. Any actions taken on the basis of this email
>> are at the recipient's own risk.
>>
>> Registered office:
>> Ivy Comptech Private Limited, Cyber Spazio, Road No. 2, Banjara Hills,
>> Hyderabad 500 033, Andhra Pradesh, India. Registered number: 37994.
>> Registered in India. A list of members' names is available for
>> inspection at the registered office.
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
--
Robert Muir
rcmuir@gmail.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
This email is sent for and on behalf of Ivy Comptech Private Limited. Ivy Comptech Private Limited is a limited liability company.
This email and any attachments are confidential, and may be legally privileged and protected by copyright. If you are not the intended recipient dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system.
Any views or opinions are solely those of the sender. This communication is not intended to form a binding contract on behalf of Ivy Comptech Private Limited unless expressly indicated to the contrary and properly authorised. Any actions taken on the basis of this email are at the recipient's own risk.
Registered office:
Ivy Comptech Private Limited, Cyber Spazio, Road No. 2, Banjara Hills, Hyderabad 500 033, Andhra Pradesh, India. Registered number: 37994. Registered in India. A list of members' names is available for inspection at the registered office.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org