You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Tom Hill (JIRA)" <ji...@apache.org> on 2009/10/13 18:59:31 UTC

[jira] Created: (LUCENE-1981) Allow access to entries in the field cache

Allow access to entries in the field cache
------------------------------------------

                 Key: LUCENE-1981
                 URL: https://issues.apache.org/jira/browse/LUCENE-1981
             Project: Lucene - Java
          Issue Type: New Feature
          Components: Search
    Affects Versions: 2.9
            Reporter: Tom Hill
            Priority: Minor


If the data required is already in the field cache, it seems unnecessary to go to the disk for it, if the data is already in RAM.

We have a case where we need one field from a large number (500 -1000) of scattered documents in a fairly large index (50-100m docs), and seek time to collect the data from disk is prohibitive, so we'd like to grab the data from the cache, instead.




-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Updated: (LUCENE-1981) Allow access to entries in the field cache

Posted by "Tom Hill (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom Hill updated LUCENE-1981:
-----------------------------

    Attachment: lucene-1981.patch

Here's a sample implementation. There are a number of possible ways to do this, but this seemed pretty minimally invasive.

Adds one method to IndexReader and subclasses.


> Allow access to entries in the field cache
> ------------------------------------------
>
>                 Key: LUCENE-1981
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1981
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Search
>    Affects Versions: 2.9
>            Reporter: Tom Hill
>            Priority: Minor
>         Attachments: lucene-1981.patch
>
>
> If the data required is already in the field cache, it seems unnecessary to go to the disk for it, if the data is already in RAM.
> We have a case where we need one field from a large number (500 -1000) of scattered documents in a fairly large index (50-100m docs), and seek time to collect the data from disk is prohibitive, so we'd like to grab the data from the cache, instead.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-1981) Allow access to entries in the field cache

Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12765157#action_12765157 ] 

Yonik Seeley commented on LUCENE-1981:
--------------------------------------

We shouldn't tie IndexReader/SegmentReader to the fieldCache.
All of the public APIs already exist to use the FieldCache instead of  document().

> Allow access to entries in the field cache
> ------------------------------------------
>
>                 Key: LUCENE-1981
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1981
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Search
>    Affects Versions: 2.9
>            Reporter: Tom Hill
>            Priority: Minor
>         Attachments: lucene-1981.patch
>
>
> If the data required is already in the field cache, it seems unnecessary to go to the disk for it, if the data is already in RAM.
> We have a case where we need one field from a large number (500 -1000) of scattered documents in a fairly large index (50-100m docs), and seek time to collect the data from disk is prohibitive, so we'd like to grab the data from the cache, instead.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Resolved: (LUCENE-1981) Allow access to entries in the field cache

Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yonik Seeley resolved LUCENE-1981.
----------------------------------

    Resolution: Invalid

> Allow access to entries in the field cache
> ------------------------------------------
>
>                 Key: LUCENE-1981
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1981
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Search
>    Affects Versions: 2.9
>            Reporter: Tom Hill
>            Priority: Minor
>         Attachments: lucene-1981.patch
>
>
> If the data required is already in the field cache, it seems unnecessary to go to the disk for it, if the data is already in RAM.
> We have a case where we need one field from a large number (500 -1000) of scattered documents in a fairly large index (50-100m docs), and seek time to collect the data from disk is prohibitive, so we'd like to grab the data from the cache, instead.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org