[jira] [Commented] (LUCENE-1206) Ability to store Reader / InputStream fields

["Trejkaz (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/LUCENE-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13591331#comment-13591331 ] 

Trejkaz commented on LUCENE-1206:
---------------------------------

I think this would still be useful. The workaround of using a separate database to store larger text and binary stuff has never really sat with me terribly well.
                
> Ability to store Reader / InputStream fields
> --------------------------------------------
>
>                 Key: LUCENE-1206
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1206
>             Project: Lucene - Core
>          Issue Type: New Feature
>          Components: core/index
>            Reporter: Trejkaz
>
> In some situations we would like to store the whole text, but the whole text won't always fit in memory so we can't create a String.  Likewise for storing binary, it would sometimes be better if we didn't have to read into a byte[] up-front (even when it doesn't use much memory, it increases the number of copies made and adds burden to GC.)
> FieldsWriter currently writes the length at the start of the chunks though, so I don't know whether it would be possible to seek back and write the length after writing the data.
> It would also be useful to use this in conjunction with compression, both for Reader and InputStream types.  And when retrieving the field, it should be possible to create a Reader without reading the entire String into memory up-front.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org