You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/04/26 11:24:14 UTC

[GitHub] [arrow-rs] alamb opened a new issue #48: [Parquet] Plain encoded boolean column chunks limited to 2048 values

alamb opened a new issue #48:
URL: https://github.com/apache/arrow-rs/issues/48


   *Note*: migrated from original JIRA: https://issues.apache.org/jira/browse/ARROW-6189
   
   encoding::PlainEncoder::new creates a BitWriter with 256 bytes of storage, which limits the data page size that can be used. 
   
   I suggest that in
   
   {{impl Encoder<BoolType> for PlainEncoder<BoolType>}}
   
   the return value of put_value is tested and the BitWriter flushed+cleared whenever it runs out of space.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org