You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by ba...@oracle.com on 2018/07/05 14:56:52 UTC

Grant Ingersoll's 2009 blog article- is there a newer version?

Hi,-
  Is there a newer version of this great article from Mr. Grant Ingersoll?

  https://lucidworks.com/2009/08/05/getting-started-with-payloads/ Thanks

This article is based on Lucene 2.9.
Best regards

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Re: Grant Ingersoll's 2009 blog article- is there a newer version?

Posted by ba...@oracle.com.
can someone point to any usage of PayloadScoreQuery class from Lucene 
please?

Best regards


On 7/5/18 4:49 PM, baris.kazar@oracle.com wrote:
> Another piece resolved: DefaultSimilarity is now ClassicSimilarity 
> since LUCENE VERSION 5.4.
>
> Best regards
>
>
> On 7/5/18 4:30 PM, baris.kazar@oracle.com wrote:
>> One thing i noticed is that org.apache.lucene.index.IndexWriter class 
>> does not have setSimilarity and it is moved to
>>
>> org.apache.lucene.index.IndexWriterConfig class. thus, i resolved the 
>> first question below.
>>
>> Best regards
>>
>>
>> On 7/5/18 3:17 PM, baris.kazar@oracle.com wrote:
>>> org.apache.lucene.index.IndexWriter class does not have 
>>> setSimilarity method, am i missing something for this?
>>>
>>> i checked multiple Lucene versions.
>>>
>>>
>>> next, i have this problem:
>>>
>>> After defining the Analyzer as the PayloadAnalyzer like on the blog 
>>> mentioned before,
>>>
>>> i declared org.apache.lucene.search.QueryParser (with the analyzer 
>>> mentioned above as the parameter) which was then used in declaring 
>>> the org.apache.lucene.search.Query object via parse method of parser.
>>>
>>> Now, i wonder how i can use PayloadScoreQuery in this scenario.
>>>
>>>
>>> Best regards
>>>
>>>
>>>
>>> On 7/5/18 1:19 PM, baris.kazar@oracle.com wrote:
>>>> i mean i know the function of BoostingTermQuery class:
>>>>
>>>> The BoostingTermQuery is very similar to the SpanTermQuery except 
>>>> that it factors in the value of the payload located at each of the 
>>>> positions where the Term occurs.
>>>>
>>>> In order to take advantage of this, you must override 
>>>> Similarity.scorePayload(String, byte[],int,int) which returns 1 by 
>>>> default.
>>>>
>>>> Payload scores are averaged across term occurrences in the document.
>>>>
>>>>
>>>> what i am asking is as follows:
>>>>
>>>> Does this mean this (BoostingTermQuery in Lucene 2.9 or 
>>>> PayloadScoerQuery in latest Lucene) needs to be called for ***all 
>>>> the words*** scored in the format i mentioned <data>|<payload or 
>>>> score> in the data?
>>>>
>>>> Best regards
>>>>
>>>> On 7/5/18 1:13 PM, baris.kazar@oracle.com wrote:
>>>>> Sure, can You please point me to the location under Lucene Solr?
>>>>>
>>>>> In Grant's article:
>>>>>
>>>>> i want to know the need to use BoostingTermQuery (now in latest 
>>>>> version PayloadScoreQuery)
>>>>>
>>>>> where we already specify payloads in the data in the form 
>>>>> <data>|<payload or score>.
>>>>>
>>>>> Best regards
>>>>>
>>>>>
>>>>>
>>>>> On 7/5/18 11:41 AM, Erick Erickson wrote:
>>>>>> Maybe look at the Solr payload code to see how to do it in Lucene?
>>>>>>
>>>>>> But yeah, that article is quite out of date.
>>>>>>
>>>>>> On Thu, Jul 5, 2018 at 8:23 AM, <ba...@oracle.com> wrote:
>>>>>>> Thanks i saw these posts but Grant's article is based on Lucene.
>>>>>>>
>>>>>>> i am not using Solr. Many classes in that article does not exist 
>>>>>>> in latest
>>>>>>> versions of Lucene like version 6.1.
>>>>>>>
>>>>>>> For instance BoostingTermQuery does not exist in 6.1 and the way 
>>>>>>> docs are
>>>>>>> indexed are also different on 6.1.
>>>>>>>
>>>>>>> There is a new class PayloadScoreQuery but there is no examples 
>>>>>>> like this
>>>>>>> great article how to put them together.
>>>>>>>
>>>>>>> Best regards
>>>>>>>
>>>>>>>
>>>>>>> On 7/5/18 11:18 AM, Ishan Chattopadhyaya wrote:
>>>>>>>> Try these, maybe?
>>>>>>>>
>>>>>>>>
>>>>>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lucidworks.com_2017_09_14_solr-2Dpayloads_&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=9hxjhLoi6Lnb7KbYaOeb4-SP039x4Zx0XIynF_HzOJk&e= 
>>>>>>>>
>>>>>>>>
>>>>>>>> https://urldefense.proofpoint.com/v2/url?u=http-3A__www.textsearch.io_-3Fp-3D5&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=elEAMRZBIF2jldvS2kCD9B3r43kZ3hOToKVyR0I4qzo&e= 
>>>>>>>>
>>>>>>>>
>>>>>>>> On Thu, Jul 5, 2018 at 8:26 PM, <ba...@oracle.com> wrote:
>>>>>>>>
>>>>>>>>> Hi,-
>>>>>>>>>    Is there a newer version of this great article from Mr. Grant
>>>>>>>>> Ingersoll?
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lucidworks.com_2009_08_05_getting-2Dstarted-2Dwith-2Dpayloads_&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=isAZ026j7ugASeuPdoeXnoi5XfSGfxEgiWECE2ziURo&e= 
>>>>>>>>>
>>>>>>>>> Thanks
>>>>>>>>>
>>>>>>>>> This article is based on Lucene 2.9.
>>>>>>>>> Best regards
>>>>>>>>>
>>>>>>>>> --------------------------------------------------------------------- 
>>>>>>>>>
>>>>>>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>>>>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>>>>> --------------------------------------------------------------------- 
>>>>>>>
>>>>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>>>>
>>>>>> --------------------------------------------------------------------- 
>>>>>>
>>>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>>>
>>>>>
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>>
>>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Re: Grant Ingersoll's 2009 blog article- is there a newer version?

Posted by ba...@oracle.com.
Another piece resolved: DefaultSimilarity is now ClassicSimilarity since 
LUCENE VERSION 5.4.

Best regards


On 7/5/18 4:30 PM, baris.kazar@oracle.com wrote:
> One thing i noticed is that org.apache.lucene.index.IndexWriter class 
> does not have setSimilarity and it is moved to
>
> org.apache.lucene.index.IndexWriterConfig class. thus, i resolved the 
> first question below.
>
> Best regards
>
>
> On 7/5/18 3:17 PM, baris.kazar@oracle.com wrote:
>> org.apache.lucene.index.IndexWriter class does not have setSimilarity 
>> method, am i missing something for this?
>>
>> i checked multiple Lucene versions.
>>
>>
>> next, i have this problem:
>>
>> After defining the Analyzer as the PayloadAnalyzer like on the blog 
>> mentioned before,
>>
>> i declared org.apache.lucene.search.QueryParser (with the analyzer 
>> mentioned above as the parameter) which was then used in declaring 
>> the org.apache.lucene.search.Query object via parse method of parser.
>>
>> Now, i wonder how i can use PayloadScoreQuery in this scenario.
>>
>>
>> Best regards
>>
>>
>>
>> On 7/5/18 1:19 PM, baris.kazar@oracle.com wrote:
>>> i mean i know the function of BoostingTermQuery class:
>>>
>>> The BoostingTermQuery is very similar to the SpanTermQuery except 
>>> that it factors in the value of the payload located at each of the 
>>> positions where the Term occurs.
>>>
>>> In order to take advantage of this, you must override 
>>> Similarity.scorePayload(String, byte[],int,int) which returns 1 by 
>>> default.
>>>
>>> Payload scores are averaged across term occurrences in the document.
>>>
>>>
>>> what i am asking is as follows:
>>>
>>> Does this mean this (BoostingTermQuery in Lucene 2.9 or 
>>> PayloadScoerQuery in latest Lucene) needs to be called for ***all 
>>> the words*** scored in the format i mentioned <data>|<payload or 
>>> score> in the data?
>>>
>>> Best regards
>>>
>>> On 7/5/18 1:13 PM, baris.kazar@oracle.com wrote:
>>>> Sure, can You please point me to the location under Lucene Solr?
>>>>
>>>> In Grant's article:
>>>>
>>>> i want to know the need to use BoostingTermQuery (now in latest 
>>>> version PayloadScoreQuery)
>>>>
>>>> where we already specify payloads in the data in the form 
>>>> <data>|<payload or score>.
>>>>
>>>> Best regards
>>>>
>>>>
>>>>
>>>> On 7/5/18 11:41 AM, Erick Erickson wrote:
>>>>> Maybe look at the Solr payload code to see how to do it in Lucene?
>>>>>
>>>>> But yeah, that article is quite out of date.
>>>>>
>>>>> On Thu, Jul 5, 2018 at 8:23 AM, <ba...@oracle.com> wrote:
>>>>>> Thanks i saw these posts but Grant's article is based on Lucene.
>>>>>>
>>>>>> i am not using Solr. Many classes in that article does not exist 
>>>>>> in latest
>>>>>> versions of Lucene like version 6.1.
>>>>>>
>>>>>> For instance BoostingTermQuery does not exist in 6.1 and the way 
>>>>>> docs are
>>>>>> indexed are also different on 6.1.
>>>>>>
>>>>>> There is a new class PayloadScoreQuery but there is no examples 
>>>>>> like this
>>>>>> great article how to put them together.
>>>>>>
>>>>>> Best regards
>>>>>>
>>>>>>
>>>>>> On 7/5/18 11:18 AM, Ishan Chattopadhyaya wrote:
>>>>>>> Try these, maybe?
>>>>>>>
>>>>>>>
>>>>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lucidworks.com_2017_09_14_solr-2Dpayloads_&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=9hxjhLoi6Lnb7KbYaOeb4-SP039x4Zx0XIynF_HzOJk&e= 
>>>>>>>
>>>>>>>
>>>>>>> https://urldefense.proofpoint.com/v2/url?u=http-3A__www.textsearch.io_-3Fp-3D5&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=elEAMRZBIF2jldvS2kCD9B3r43kZ3hOToKVyR0I4qzo&e= 
>>>>>>>
>>>>>>>
>>>>>>> On Thu, Jul 5, 2018 at 8:26 PM, <ba...@oracle.com> wrote:
>>>>>>>
>>>>>>>> Hi,-
>>>>>>>>    Is there a newer version of this great article from Mr. Grant
>>>>>>>> Ingersoll?
>>>>>>>>
>>>>>>>>
>>>>>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lucidworks.com_2009_08_05_getting-2Dstarted-2Dwith-2Dpayloads_&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=isAZ026j7ugASeuPdoeXnoi5XfSGfxEgiWECE2ziURo&e= 
>>>>>>>>
>>>>>>>> Thanks
>>>>>>>>
>>>>>>>> This article is based on Lucene 2.9.
>>>>>>>> Best regards
>>>>>>>>
>>>>>>>> --------------------------------------------------------------------- 
>>>>>>>>
>>>>>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>>>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>>>>>
>>>>>>>>
>>>>>>
>>>>>> --------------------------------------------------------------------- 
>>>>>>
>>>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>>
>>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Re: Grant Ingersoll's 2009 blog article- is there a newer version?

Posted by ba...@oracle.com.
One thing i noticed is that org.apache.lucene.index.IndexWriter class 
does not have setSimilarity and it is moved to

org.apache.lucene.index.IndexWriterConfig class. thus, i resolved the 
first question below.

Best regards


On 7/5/18 3:17 PM, baris.kazar@oracle.com wrote:
> org.apache.lucene.index.IndexWriter class does not have setSimilarity 
> method, am i missing something for this?
>
> i checked multiple Lucene versions.
>
>
> next, i have this problem:
>
> After defining the Analyzer as the PayloadAnalyzer like on the blog 
> mentioned before,
>
> i declared org.apache.lucene.search.QueryParser (with the analyzer 
> mentioned above as the parameter) which was then used in declaring the 
> org.apache.lucene.search.Query object via parse method of parser.
>
> Now, i wonder how i can use PayloadScoreQuery in this scenario.
>
>
> Best regards
>
>
>
> On 7/5/18 1:19 PM, baris.kazar@oracle.com wrote:
>> i mean i know the function of BoostingTermQuery class:
>>
>> The BoostingTermQuery is very similar to the SpanTermQuery except 
>> that it factors in the value of the payload located at each of the 
>> positions where the Term occurs.
>>
>> In order to take advantage of this, you must override 
>> Similarity.scorePayload(String, byte[],int,int) which returns 1 by 
>> default.
>>
>> Payload scores are averaged across term occurrences in the document.
>>
>>
>> what i am asking is as follows:
>>
>> Does this mean this (BoostingTermQuery in Lucene 2.9 or 
>> PayloadScoerQuery in latest Lucene) needs to be called for ***all the 
>> words*** scored in the format i mentioned <data>|<payload or score> 
>> in the data?
>>
>> Best regards
>>
>> On 7/5/18 1:13 PM, baris.kazar@oracle.com wrote:
>>> Sure, can You please point me to the location under Lucene Solr?
>>>
>>> In Grant's article:
>>>
>>> i want to know the need to use BoostingTermQuery (now in latest 
>>> version PayloadScoreQuery)
>>>
>>> where we already specify payloads in the data in the form 
>>> <data>|<payload or score>.
>>>
>>> Best regards
>>>
>>>
>>>
>>> On 7/5/18 11:41 AM, Erick Erickson wrote:
>>>> Maybe look at the Solr payload code to see how to do it in Lucene?
>>>>
>>>> But yeah, that article is quite out of date.
>>>>
>>>> On Thu, Jul 5, 2018 at 8:23 AM, <ba...@oracle.com> wrote:
>>>>> Thanks i saw these posts but Grant's article is based on Lucene.
>>>>>
>>>>> i am not using Solr. Many classes in that article does not exist 
>>>>> in latest
>>>>> versions of Lucene like version 6.1.
>>>>>
>>>>> For instance BoostingTermQuery does not exist in 6.1 and the way 
>>>>> docs are
>>>>> indexed are also different on 6.1.
>>>>>
>>>>> There is a new class PayloadScoreQuery but there is no examples 
>>>>> like this
>>>>> great article how to put them together.
>>>>>
>>>>> Best regards
>>>>>
>>>>>
>>>>> On 7/5/18 11:18 AM, Ishan Chattopadhyaya wrote:
>>>>>> Try these, maybe?
>>>>>>
>>>>>>
>>>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lucidworks.com_2017_09_14_solr-2Dpayloads_&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=9hxjhLoi6Lnb7KbYaOeb4-SP039x4Zx0XIynF_HzOJk&e= 
>>>>>>
>>>>>>
>>>>>> https://urldefense.proofpoint.com/v2/url?u=http-3A__www.textsearch.io_-3Fp-3D5&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=elEAMRZBIF2jldvS2kCD9B3r43kZ3hOToKVyR0I4qzo&e= 
>>>>>>
>>>>>>
>>>>>> On Thu, Jul 5, 2018 at 8:26 PM, <ba...@oracle.com> wrote:
>>>>>>
>>>>>>> Hi,-
>>>>>>>    Is there a newer version of this great article from Mr. Grant
>>>>>>> Ingersoll?
>>>>>>>
>>>>>>>
>>>>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lucidworks.com_2009_08_05_getting-2Dstarted-2Dwith-2Dpayloads_&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=isAZ026j7ugASeuPdoeXnoi5XfSGfxEgiWECE2ziURo&e= 
>>>>>>>
>>>>>>> Thanks
>>>>>>>
>>>>>>> This article is based on Lucene 2.9.
>>>>>>> Best regards
>>>>>>>
>>>>>>> --------------------------------------------------------------------- 
>>>>>>>
>>>>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>>>>
>>>>>>>
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Re: Grant Ingersoll's 2009 blog article- is there a newer version?

Posted by ba...@oracle.com.
org.apache.lucene.index.IndexWriter class does not have setSimilarity 
method, am i missing something for this?

i checked multiple Lucene versions.


next, i have this problem:

After defining the Analyzer as the PayloadAnalyzer like on the blog 
mentioned before,

i declared org.apache.lucene.search.QueryParser (with the analyzer 
mentioned above as the parameter) which was then used in declaring the 
org.apache.lucene.search.Query object via parse method of parser.

Now, i wonder how i can use PayloadScoreQuery in this scenario.


Best regards



On 7/5/18 1:19 PM, baris.kazar@oracle.com wrote:
> i mean i know the function of BoostingTermQuery class:
>
> The BoostingTermQuery is very similar to the SpanTermQuery except that 
> it factors in the value of the payload located at each of the 
> positions where the Term occurs.
>
> In order to take advantage of this, you must override 
> Similarity.scorePayload(String, byte[],int,int) which returns 1 by 
> default.
>
> Payload scores are averaged across term occurrences in the document.
>
>
> what i am asking is as follows:
>
> Does this mean this (BoostingTermQuery in Lucene 2.9 or 
> PayloadScoerQuery in latest Lucene) needs to be called for ***all the 
> words*** scored in the format i mentioned <data>|<payload or score> in 
> the data?
>
> Best regards
>
> On 7/5/18 1:13 PM, baris.kazar@oracle.com wrote:
>> Sure, can You please point me to the location under Lucene Solr?
>>
>> In Grant's article:
>>
>> i want to know the need to use BoostingTermQuery (now in latest 
>> version PayloadScoreQuery)
>>
>> where we already specify payloads in the data in the form 
>> <data>|<payload or score>.
>>
>> Best regards
>>
>>
>>
>> On 7/5/18 11:41 AM, Erick Erickson wrote:
>>> Maybe look at the Solr payload code to see how to do it in Lucene?
>>>
>>> But yeah, that article is quite out of date.
>>>
>>> On Thu, Jul 5, 2018 at 8:23 AM, <ba...@oracle.com> wrote:
>>>> Thanks i saw these posts but Grant's article is based on Lucene.
>>>>
>>>> i am not using Solr. Many classes in that article does not exist in 
>>>> latest
>>>> versions of Lucene like version 6.1.
>>>>
>>>> For instance BoostingTermQuery does not exist in 6.1 and the way 
>>>> docs are
>>>> indexed are also different on 6.1.
>>>>
>>>> There is a new class PayloadScoreQuery but there is no examples 
>>>> like this
>>>> great article how to put them together.
>>>>
>>>> Best regards
>>>>
>>>>
>>>> On 7/5/18 11:18 AM, Ishan Chattopadhyaya wrote:
>>>>> Try these, maybe?
>>>>>
>>>>>
>>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lucidworks.com_2017_09_14_solr-2Dpayloads_&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=9hxjhLoi6Lnb7KbYaOeb4-SP039x4Zx0XIynF_HzOJk&e= 
>>>>>
>>>>>
>>>>> https://urldefense.proofpoint.com/v2/url?u=http-3A__www.textsearch.io_-3Fp-3D5&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=elEAMRZBIF2jldvS2kCD9B3r43kZ3hOToKVyR0I4qzo&e= 
>>>>>
>>>>>
>>>>> On Thu, Jul 5, 2018 at 8:26 PM, <ba...@oracle.com> wrote:
>>>>>
>>>>>> Hi,-
>>>>>>    Is there a newer version of this great article from Mr. Grant
>>>>>> Ingersoll?
>>>>>>
>>>>>>
>>>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lucidworks.com_2009_08_05_getting-2Dstarted-2Dwith-2Dpayloads_&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=isAZ026j7ugASeuPdoeXnoi5XfSGfxEgiWECE2ziURo&e= 
>>>>>>
>>>>>> Thanks
>>>>>>
>>>>>> This article is based on Lucene 2.9.
>>>>>> Best regards
>>>>>>
>>>>>> --------------------------------------------------------------------- 
>>>>>>
>>>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>>>
>>>>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Re: Grant Ingersoll's 2009 blog article- is there a newer version?

Posted by ba...@oracle.com.
i mean i know the function of BoostingTermQuery class:

The BoostingTermQuery is very similar to the SpanTermQuery except that 
it factors in the value of the payload located at each of the positions 
where the Term occurs.

In order to take advantage of this, you must override 
Similarity.scorePayload(String, byte[],int,int) which returns 1 by default.

Payload scores are averaged across term occurrences in the document.


what i am asking is as follows:

Does this mean this (BoostingTermQuery in Lucene 2.9 or 
PayloadScoerQuery in latest Lucene) needs to be called for ***all the 
words*** scored in the format i mentioned <data>|<payload or score> in 
the data?

Best regards

On 7/5/18 1:13 PM, baris.kazar@oracle.com wrote:
> Sure, can You please point me to the location under Lucene Solr?
>
> In Grant's article:
>
> i want to know the need to use BoostingTermQuery (now in latest 
> version PayloadScoreQuery)
>
> where we already specify payloads in the data in the form 
> <data>|<payload or score>.
>
> Best regards
>
>
>
> On 7/5/18 11:41 AM, Erick Erickson wrote:
>> Maybe look at the Solr payload code to see how to do it in Lucene?
>>
>> But yeah, that article is quite out of date.
>>
>> On Thu, Jul 5, 2018 at 8:23 AM,  <ba...@oracle.com> wrote:
>>> Thanks i saw these posts but Grant's article is based on Lucene.
>>>
>>> i am not using Solr. Many classes in that article does not exist in 
>>> latest
>>> versions of Lucene like version 6.1.
>>>
>>> For instance BoostingTermQuery does not exist in 6.1 and the way 
>>> docs are
>>> indexed are also different on 6.1.
>>>
>>> There is a new class PayloadScoreQuery but there is no examples like 
>>> this
>>> great article how to put them together.
>>>
>>> Best regards
>>>
>>>
>>> On 7/5/18 11:18 AM, Ishan Chattopadhyaya wrote:
>>>> Try these, maybe?
>>>>
>>>>
>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lucidworks.com_2017_09_14_solr-2Dpayloads_&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=9hxjhLoi6Lnb7KbYaOeb4-SP039x4Zx0XIynF_HzOJk&e= 
>>>>
>>>>
>>>> https://urldefense.proofpoint.com/v2/url?u=http-3A__www.textsearch.io_-3Fp-3D5&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=elEAMRZBIF2jldvS2kCD9B3r43kZ3hOToKVyR0I4qzo&e= 
>>>>
>>>>
>>>> On Thu, Jul 5, 2018 at 8:26 PM, <ba...@oracle.com> wrote:
>>>>
>>>>> Hi,-
>>>>>    Is there a newer version of this great article from Mr. Grant
>>>>> Ingersoll?
>>>>>
>>>>>
>>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lucidworks.com_2009_08_05_getting-2Dstarted-2Dwith-2Dpayloads_&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=isAZ026j7ugASeuPdoeXnoi5XfSGfxEgiWECE2ziURo&e= 
>>>>>
>>>>> Thanks
>>>>>
>>>>> This article is based on Lucene 2.9.
>>>>> Best regards
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>>
>>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Re: Grant Ingersoll's 2009 blog article- is there a newer version?

Posted by ba...@oracle.com.
Sure, can You please point me to the location under Lucene Solr?

In Grant's article:

i want to know the need to use BoostingTermQuery (now in latest version 
PayloadScoreQuery)

where we already specify payloads in the data in the form 
<data>|<payload or score>.

Best regards



On 7/5/18 11:41 AM, Erick Erickson wrote:
> Maybe look at the Solr payload code to see how to do it in Lucene?
>
> But yeah, that article is quite out of date.
>
> On Thu, Jul 5, 2018 at 8:23 AM,  <ba...@oracle.com> wrote:
>> Thanks i saw these posts but Grant's article is based on Lucene.
>>
>> i am not using Solr. Many classes in that article does not exist in latest
>> versions of Lucene like version 6.1.
>>
>> For instance BoostingTermQuery does not exist in 6.1 and the way docs are
>> indexed are also different on 6.1.
>>
>> There is a new class PayloadScoreQuery but there is no examples like this
>> great article how to put them together.
>>
>> Best regards
>>
>>
>> On 7/5/18 11:18 AM, Ishan Chattopadhyaya wrote:
>>> Try these, maybe?
>>>
>>>
>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lucidworks.com_2017_09_14_solr-2Dpayloads_&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=9hxjhLoi6Lnb7KbYaOeb4-SP039x4Zx0XIynF_HzOJk&e=
>>>
>>> https://urldefense.proofpoint.com/v2/url?u=http-3A__www.textsearch.io_-3Fp-3D5&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=elEAMRZBIF2jldvS2kCD9B3r43kZ3hOToKVyR0I4qzo&e=
>>>
>>> On Thu, Jul 5, 2018 at 8:26 PM, <ba...@oracle.com> wrote:
>>>
>>>> Hi,-
>>>>    Is there a newer version of this great article from Mr. Grant
>>>> Ingersoll?
>>>>
>>>>
>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lucidworks.com_2009_08_05_getting-2Dstarted-2Dwith-2Dpayloads_&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=isAZ026j7ugASeuPdoeXnoi5XfSGfxEgiWECE2ziURo&e=
>>>> Thanks
>>>>
>>>> This article is based on Lucene 2.9.
>>>> Best regards
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>
>>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Re: Grant Ingersoll's 2009 blog article- is there a newer version?

Posted by Erick Erickson <er...@gmail.com>.
Maybe look at the Solr payload code to see how to do it in Lucene?

But yeah, that article is quite out of date.

On Thu, Jul 5, 2018 at 8:23 AM,  <ba...@oracle.com> wrote:
> Thanks i saw these posts but Grant's article is based on Lucene.
>
> i am not using Solr. Many classes in that article does not exist in latest
> versions of Lucene like version 6.1.
>
> For instance BoostingTermQuery does not exist in 6.1 and the way docs are
> indexed are also different on 6.1.
>
> There is a new class PayloadScoreQuery but there is no examples like this
> great article how to put them together.
>
> Best regards
>
>
> On 7/5/18 11:18 AM, Ishan Chattopadhyaya wrote:
>>
>> Try these, maybe?
>>
>>
>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lucidworks.com_2017_09_14_solr-2Dpayloads_&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=9hxjhLoi6Lnb7KbYaOeb4-SP039x4Zx0XIynF_HzOJk&e=
>>
>> https://urldefense.proofpoint.com/v2/url?u=http-3A__www.textsearch.io_-3Fp-3D5&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=elEAMRZBIF2jldvS2kCD9B3r43kZ3hOToKVyR0I4qzo&e=
>>
>> On Thu, Jul 5, 2018 at 8:26 PM, <ba...@oracle.com> wrote:
>>
>>> Hi,-
>>>   Is there a newer version of this great article from Mr. Grant
>>> Ingersoll?
>>>
>>>
>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lucidworks.com_2009_08_05_getting-2Dstarted-2Dwith-2Dpayloads_&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=isAZ026j7ugASeuPdoeXnoi5XfSGfxEgiWECE2ziURo&e=
>>> Thanks
>>>
>>> This article is based on Lucene 2.9.
>>> Best regards
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>
>>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Re: Grant Ingersoll's 2009 blog article- is there a newer version?

Posted by ba...@oracle.com.
Thanks i saw these posts but Grant's article is based on Lucene.

i am not using Solr. Many classes in that article does not exist in 
latest versions of Lucene like version 6.1.

For instance BoostingTermQuery does not exist in 6.1 and the way docs 
are indexed are also different on 6.1.

There is a new class PayloadScoreQuery but there is no examples like 
this great article how to put them together.

Best regards


On 7/5/18 11:18 AM, Ishan Chattopadhyaya wrote:
> Try these, maybe?
>
> https://urldefense.proofpoint.com/v2/url?u=https-3A__lucidworks.com_2017_09_14_solr-2Dpayloads_&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=9hxjhLoi6Lnb7KbYaOeb4-SP039x4Zx0XIynF_HzOJk&e=
> https://urldefense.proofpoint.com/v2/url?u=http-3A__www.textsearch.io_-3Fp-3D5&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=elEAMRZBIF2jldvS2kCD9B3r43kZ3hOToKVyR0I4qzo&e=
>
> On Thu, Jul 5, 2018 at 8:26 PM, <ba...@oracle.com> wrote:
>
>> Hi,-
>>   Is there a newer version of this great article from Mr. Grant Ingersoll?
>>
>>   https://urldefense.proofpoint.com/v2/url?u=https-3A__lucidworks.com_2009_08_05_getting-2Dstarted-2Dwith-2Dpayloads_&d=DwIBaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=nlG5z5NcNdIbQAiX-BKNeyLlULCbaezrgocEvPhQkl4&m=Ak4sr1zTaxPibIGJz26XQrj9fM4hZls8OegNbEWu1lI&s=isAZ026j7ugASeuPdoeXnoi5XfSGfxEgiWECE2ziURo&e= Thanks
>>
>> This article is based on Lucene 2.9.
>> Best regards
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Re: Grant Ingersoll's 2009 blog article- is there a newer version?

Posted by Ishan Chattopadhyaya <ic...@gmail.com>.
Try these, maybe?

https://lucidworks.com/2017/09/14/solr-payloads/
http://www.textsearch.io/?p=5

On Thu, Jul 5, 2018 at 8:26 PM, <ba...@oracle.com> wrote:

> Hi,-
>  Is there a newer version of this great article from Mr. Grant Ingersoll?
>
>  https://lucidworks.com/2009/08/05/getting-started-with-payloads/ Thanks
>
> This article is based on Lucene 2.9.
> Best regards
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>