You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "aaron-mongodb (via GitHub)" <gi...@apache.org> on 2023/03/07 21:06:35 UTC

[GitHub] [arrow] aaron-mongodb opened a new issue, #34492: PlainBooleanEncoder occasionally emits incorrect data over page boundaries

aaron-mongodb opened a new issue, #34492:
URL: https://github.com/apache/arrow/issues/34492

   ### Describe the bug, including details regarding any error messages, version, and platform.
   
   The `PlainBooleanEncoder` is used in a way indicating that `FlushValues` "resets" its state. However, the intermediate `BitMapWriter`'s position state is not reset. In rare cases this can cause something akin to "stale" values being flushed to the column. The most immediate manifestation of this is in the Boolean statistics: e.g., on the rowgroup stats, if there is a single "true" value in the column, the way it emits maxvalue followed by minvalue reveals that the `true` maxvalue is emitted for both.
   
   I have a fix with tests in an incoming PR.
   
   ### Component(s)
   
   Go


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow] zeroshade closed issue #34492: PlainBooleanEncoder occasionally emits incorrect data over page boundaries

Posted by "zeroshade (via GitHub)" <gi...@apache.org>.
zeroshade closed issue #34492: PlainBooleanEncoder occasionally emits incorrect data over page boundaries
URL: https://github.com/apache/arrow/issues/34492


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org