You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Grant Ingersoll (JIRA)" <ji...@apache.org> on 2007/01/24 03:33:49 UTC

[jira] Commented: (LUCENE-762) [PATCH] Efficiently retrieve sizes of field values

    [ https://issues.apache.org/jira/browse/LUCENE-762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12466885 ] 

Grant Ingersoll commented on LUCENE-762:
----------------------------------------

This would also eliminate the need to change FieldsReader for every new FieldSelectorResult that we want.  The downside is that it would most likely involve some reworking of FieldSelectorResult.  This probably isn't a big deal, since the FieldSelector stuff hasn't been released yet and has been noted to be experimental, but it has been on trunk for a while, so it is in use, I'm sure.  I think Solr has incorporated it, but I am not sure.

Patch that incorporates your existing patch and this new approach to follow soon.

> [PATCH] Efficiently retrieve sizes of field values
> --------------------------------------------------
>
>                 Key: LUCENE-762
>                 URL: https://issues.apache.org/jira/browse/LUCENE-762
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Store
>    Affects Versions: 2.1
>            Reporter: Chuck Williams
>         Assigned To: Grant Ingersoll
>            Priority: Minor
>         Attachments: SizeFieldSelector.patch
>
>
> Sometimes an application would like to know how large a document is before retrieving it.  This can be important for memory management or choosing between algorithms, especially in cases where documents might be very large.
> This patch extends the existing FieldSelector mechanism with two new FieldSelectorResults:  SIZE and SIZE_AND_BREAK.  SIZE creates fields on the retrieved document that store field sizes instead of actual values.  SIZE_AND_BREAK is especially efficient if one field comprises the bulk of the document size (e.g., the body field) and can thus be used as a reasonable size approximation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Re: [jira] Commented: (LUCENE-762) [PATCH] Efficiently retrieve sizes of field values

Posted by Mike Klaas <mi...@gmail.com>.
On 1/25/07, Grant Ingersoll <gs...@apache.org> wrote:
> Mike,
>
> Do you have any preference on making FieldInfo public versus moving
> the FieldSelector stuff into the index package?

Not at all.  Our use is pretty basic as will be easy to modify to
conform to class movement/renaming.

-Mike

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Re: [jira] Commented: (LUCENE-762) [PATCH] Efficiently retrieve sizes of field values

Posted by Grant Ingersoll <gs...@apache.org>.
Mike,

Do you have any preference on making FieldInfo public versus moving  
the FieldSelector stuff into the index package?

-Grant

On Jan 23, 2007, at 10:23 PM, Mike Klaas wrote:

> On 1/23/07, Grant Ingersoll (JIRA) <ji...@apache.org> wrote:
>>
>>     [ https://issues.apache.org/jira/browse/LUCENE-762? 
>> page=com.atlassian.jira.plugin.system.issuetabpanels:comment- 
>> tabpanel#action_12466885 ]
>>
>> Grant Ingersoll commented on LUCENE-762:
>> ----------------------------------------
>>
>> This would also eliminate the need to change FieldsReader for  
>> every new FieldSelectorResult that we want.  The downside is that  
>> it would most likely involve some reworking of  
>> FieldSelectorResult.  This probably isn't a big deal, since the  
>> FieldSelector stuff hasn't been released yet and has been noted to  
>> be experimental, but it has been on trunk for a while, so it is in  
>> use, I'm sure.  I think Solr has incorporated it, but I am not sure.
>
> Yes, we have incorporated it and it is in release 1.1.  However,  it
> is a backend optimization that isn't exposed to the user (except
> perhaps some doing fancy things with custom RequestHandlers), so it
> isn't too much trouble to modify.
>
> -Mike
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-dev-help@lucene.apache.org
>

--------------------------
Grant Ingersoll
Center for Natural Language Processing
http://www.cnlp.org

Read the Lucene Java FAQ at http://wiki.apache.org/jakarta-lucene/ 
LuceneFAQ



---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Re: [jira] Commented: (LUCENE-762) [PATCH] Efficiently retrieve sizes of field values

Posted by Mike Klaas <mi...@gmail.com>.
On 1/23/07, Grant Ingersoll (JIRA) <ji...@apache.org> wrote:
>
>     [ https://issues.apache.org/jira/browse/LUCENE-762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12466885 ]
>
> Grant Ingersoll commented on LUCENE-762:
> ----------------------------------------
>
> This would also eliminate the need to change FieldsReader for every new FieldSelectorResult that we want.  The downside is that it would most likely involve some reworking of FieldSelectorResult.  This probably isn't a big deal, since the FieldSelector stuff hasn't been released yet and has been noted to be experimental, but it has been on trunk for a while, so it is in use, I'm sure.  I think Solr has incorporated it, but I am not sure.

Yes, we have incorporated it and it is in release 1.1.  However,  it
is a backend optimization that isn't exposed to the user (except
perhaps some doing fancy things with custom RequestHandlers), so it
isn't too much trouble to modify.

-Mike

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org