You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/06/09 17:47:14 UTC

[GitHub] [arrow-rs] Pand9 edited a comment on issue #349: parquet reading hangs when row_group contains more than 2048 rows of data

Pand9 edited a comment on issue #349:
URL: https://github.com/apache/arrow-rs/issues/349#issuecomment-857903895


   I've also just encountered it. Common element with this reproduction is BOOLEAN field. It worked without BOOLEAN as well.
   
   After quick investigation of the looping code, I've found something suspect, but it's just about naming - not sure if it's actual bug.
   
   This function returns something initialized as input's length and called `values_to_read`: https://github.com/apache/arrow-rs/blob/0f55b828883b3b3afda43ae404b130d374e6f1a1/parquet/src/util/bit_util.rs#L588
   
   Meanwhile calling site assigns the return value to `values_read`.
   
   Btw it loops because after reading 2048 values, it's 0.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org