You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@commons.apache.org by "Sebb (JIRA)" <ji...@apache.org> on 2013/05/20 01:13:16 UTC

[jira] [Created] (IO-382) Chunked IO for large arrays

Sebb created IO-382:
-----------------------

             Summary: Chunked IO for large arrays
                 Key: IO-382
                 URL: https://issues.apache.org/jira/browse/IO-382
             Project: Commons IO
          Issue Type: New Feature
          Components: Utilities
            Reporter: Sebb


File IO involves native code at some point.
It seems that native code which accesses a Java
array may involve copying the array (depending on the JVM) [1]

This can easily lead to an OutOfMemory condition if the array is large.

It would be useful to provide some utility methods to process the array in chunks of (say) 4K. It's unlikely that applications will use huge read buffers, but they may well need to write large buffers, so only output chunking is likely to be useful.

It might also be useful to create a ChunkedOutputStream/Writer which provides the chunking automatically.

[1] http://docs.oracle.com/javase/7/docs/technotes/guides/jni/spec/design.html#wp1265



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira