You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Simon Jones (JIRA)" <ji...@apache.org> on 2019/08/09 16:59:00 UTC

[jira] [Created] (ARROW-6189) [Rust] Plain encoded boolean column chunks limited to 2048 values

Simon Jones created ARROW-6189:
----------------------------------

             Summary: [Rust] Plain encoded boolean column chunks limited to 2048 values
                 Key: ARROW-6189
                 URL: https://issues.apache.org/jira/browse/ARROW-6189
             Project: Apache Arrow
          Issue Type: Bug
          Components: Rust
    Affects Versions: 0.14.1
            Reporter: Simon Jones


encoding::PlainEncoder::new creates a BitWriter with 256 bytes of storage, which limits the data page size that can be used. 

I suggest that in

{{impl Encoder<BoolType> for PlainEncoder<BoolType>}}

the return value of put_value is tested and the BitWriter flushed+cleared whenever it runs out of space.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)