You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2016/12/01 16:40:58 UTC

[jira] [Created] (ARROW-398) [Java] Java file format requires bitmaps of all 1's to be written when there are no nulls

Wes McKinney created ARROW-398:
----------------------------------

             Summary: [Java] Java file format requires bitmaps of all 1's to be written when there are no nulls
                 Key: ARROW-398
                 URL: https://issues.apache.org/jira/browse/ARROW-398
             Project: Apache Arrow
          Issue Type: Bug
          Components: Java - Vectors
            Reporter: Wes McKinney
            Priority: Blocker


From the format specification "Arrays having a 0 null count may choose to not allocate the null bitmap. Implementations may choose to always allocate one anyway as a matter of convenience, but this should be noted when memory is being shared."

When the null count is 0 and the validity buffer has length 0, then in Java for now the simplest thing will be to allocate a new validity buffer with all 1's. See the corresponding C++ logic where a 0-length buffer is being written when the null count is 0: https://github.com/apache/arrow/blob/master/cpp/src/arrow/ipc/adapter.cc#L83





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)