You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/05/20 18:39:05 UTC

[GitHub] [arrow-rs] yordan-pavlov commented on pull request #325: parquet: Speed up `BitReader`/`DeltaBitPackDecoder`

yordan-pavlov commented on pull request #325:
URL: https://github.com/apache/arrow-rs/pull/325#issuecomment-845370004


   @kornholi thank you for looking into `BitReader` and `DeltaBitPackDecoder`; these performance improvements will combine very will with the change I have been working on here https://github.com/apache/arrow-rs/issues/200; similar to you, I have also found the current implementation of the parquet reader to be fairly inefficient in some places where for example it's unnecessarily creating clones of `ByteBufferPtr`, or allocating `Vec`s, etc. I can't wait to see what the combined performance improvements will be. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org