You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by "alamb (via GitHub)" <gi...@apache.org> on 2025/09/04 16:25:54 UTC

Re: [I] [Epic] Implement `RunArray` (Run Length Encoding (RLE) / Run End Encoding (REE) support) [arrow-rs]

alamb commented on issue #3520:
URL: https://github.com/apache/arrow-rs/issues/3520#issuecomment-3254515876

   > I'm happy to help with this, especially anything related to supporting REE in parquet
   
   Thank you @albertlockett 
   
   One big missing piece I know if is the ability to read data from Parquet as REE arrays -- even though often the pages are compressed with the REE/Bit packing hybrid
   
   So the idea would be to specify to the parquet reader that we wanted to read data as an REE array and then implement the appropriate decoders to do that
   
   Before doing this it would likely be very helpful to create some sort of benchmark / example where reading an REE array directly would help a lot (maybe a column with very many repeated string values 🤔 )


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org