You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by "Eric Wohlstadter (JIRA)" <ji...@apache.org> on 2018/05/23 17:35:00 UTC
[jira] [Created] (ARROW-2632) [Java] ArrowStreamWriter accumulates
ArrowBlock but does not use them
Eric Wohlstadter created ARROW-2632:
---------------------------------------
Summary: [Java] ArrowStreamWriter accumulates ArrowBlock but does not use them
Key: ARROW-2632
URL: https://issues.apache.org/jira/browse/ARROW-2632
Project: Apache Arrow
Issue Type: Bug
Components: Java - Vectors
Reporter: Eric Wohlstadter
Fix For: 0.10.0
{{ArrowStreamWriter}} inherits from {{ArrowWriter}} the behavior of accumulating an {{ArrowBlock}} for each {{ArrowRecordBatch}} that is written. But this data is never used in the context of {{ArrowStreamWriter}}.
{code:java}
public abstract class ArrowWriter implements AutoCloseable {
private final List<ArrowBlock> recordBlocks = new ArrayList<>();
...
protected void writeRecordBatch(ArrowRecordBatch batch) {
...
recordBlocks.add(block);
}
}
{code}
{{writeRecordBatch}} can be overridden in {{ArrowStreamWriter}} to avoid adding the memory overhead.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)