You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "LuYunCheng (Jira)" <ji...@apache.org> on 2022/07/18 11:47:00 UTC

[jira] [Created] (LUCENE-10657) Reduce memory copy in DataOutput copyBytes

LuYunCheng created LUCENE-10657:
-----------------------------------

             Summary: Reduce memory copy in DataOutput copyBytes
                 Key: LUCENE-10657
                 URL: https://issues.apache.org/jira/browse/LUCENE-10657
             Project: Lucene - Core
          Issue Type: Improvement
          Components: core/store
            Reporter: LuYunCheng


This is derived from [LUCENE-10627|[https://github.com/apache/lucene/pull/987]|https://github.com/apache/lucene/pull/987].]

The abstract method `copyBytes` in DataOutput have to copy from input to a copyBuffer and then write into ByteBuffersDataOutput.blocks, i think there is unnecessary, we can override it, copy directly from input into output.

with override this method,
 # Reduce memory copy in `Lucene90CompressingStoredFieldsWriter#copyOneDoc` -> `bufferdDocs.copyBytes(DataInput input)`
 # Reduce memory copy in `Lucene90CompoundFormat.writeCompoundFile` -> `data.copyBytes` when input is `BufferedChecksumIndexinput` and output is `ByteBuffersDataOutput`
 # Reduce memory `IndexWriter#copySegmentAsIs` ->CopyFrom -> copyBytes

 
 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org